


Institutional Archive of the Naval Postgraduate School 





Calhoun: The NPS Institutional Archive 
DSpace Repository 


Theses and Dissertations 1. Thesis and Dissertation Collection, all items 


1989-06 


Experimental research and empirical testing 
of distributed Group Decision Support Systems 


Clark, Cindy; Miller, R. Warren 


Monterey, California. Naval Postgraduate School 
http://ndl.handle.net/10945/42109 


This publication is a work of the U.S. Government as defined in Title 17, United 
States Code, Section 101. Copyright protection is not available for this work in the 
United States. 


Downloaded from NPS Archive: Calhoun 


Calhoun is the Naval Postgraduate School's public access digital repository for 


(8 DUDLEY research materials and institutional publications created by the NPS community. 
«ist sae Calhoun is named for Professor of Mathematics Guy K. Calhoun, NPS'‘s first 


INN KNOX appointed — and published -- scholarly author. 

| LIBRARY Dudley Knox Library / Naval Postgraduate School 

411 Dyer Road / 1 University Circle 
Monterey, California USA 93943 





http://www.nps.edu/library 






iting: Laat etuegs 1 oo aie ee a 


1 #/ 68.160-4 ASD rene v4: LP ot ri Ge re pi Be My A Atala. we 





























































































































































































































































































































































































ar SA ue ng a aa we Bots FANE Pay eh Oe eee va Ti 
Le mate : s# uh © he ta ? 4 ry 44 4 .Beatas ¥ ate atts singe — frets 
’ 1 ‘ e Aviwhe * Rebs ia a tabod, is tthgoaBinth. «24 $518 Piro dae Tee) Tere 
" nh Ag ny ue java Pe ey ee en : aa adhe moet VG 4 rie reyes ttre a 
1 ' Qi ‘yaw sae 80 tA a 3 4M IF4 Ordo M ng CtAY Age PAO ige? UROL ey we Suenpeetaee ue. 
‘ zs eels @ rn faa A FPO MEK PL shamn Ab eal ere prs em 1. Cap@ ana 
= 4 q t pls SA sd Geotidrs. Alda Abie tas eMeAGAIb SR ATAS § OA tal b Wahe® TRS @ £4 Like EMT 49 OWA KRIRs CRgov B 
ee Pode! Ase, 8 de te Lee 2 H.e0 G0 has Wega orn, isvtdt Deentounen (o%e.b¢a0hA0P ures 
: ; 1.8 wy, BBL alk aah adeeb UP a te Mm ode of 80 Masts niactoe te he 4m e(eobem> Demmollrae owe 
i uf BIE ei A te Be els RMR OE mote PAL, WM AE LD be B18 TASK te Utae 9.04. 40-4: 9 -R8tan gm Bie 
um 7a o, "gata, fet ~*e? a SO uaetsfe diet esthage Yt ¢ beasatew @& vB a8, Ase” toGersgat-a gtd £a7 2902818 JOR Ams 
' ' Wed eretee Ff FFE Mb PMO Baie tte gfe 0 + FO. Beta get a terut item Ages yet Ms MLGERARGG IM Rad shel 01 Ss tee 
: Sse, 3 Wer FH wr tM 28 Ao hm 88 He ees sen PH BO BBE AIAN RI 6 OIG Bath 186 Gon 1504 06Mm MGs Us Ou Ree snees Os TOMID 
1 . au ' Ltd atte abet jee was Oo PASH RRM, MERA O % M646 VA eMad OeTe & bit 0466 iar esaees aT AerCe Te 
' " % ‘ ie Le id PAST ye, 01459 %4' O94 to WEES OEP Ys ' 8 50p Rite MaPdl hGdes ree oe: 
ae ae co Site & Veh t zy Ass ofthat 4, B dems WA. 2 ote r sagaset 200 ‘ 
ves . 4 ' 6 ° Ok ie * uwewe shale seme a) RA Ad Mn 448.0 Le. oH ey ey Beret Aen eG NA ite NEA. BL og O10 Res eR ee 
‘ : 4 ey A ee 2 ote gat Mee BaP we HO RANG gm Metis Made MUR. 0 ¥5- *ousee gums ade ten ya. ser (ae P iM HD S000 tPd°D' AaRave 
ou Oe 4 - 1 Ge 9 Des ast pire Lay ne ve eegreienl obra: ak ITT VLA? Lee paeey mT) Tree Se sae eae | ORDT RO Rody he oe 
c a ‘ : he oA ty Rsh SAI Os wey ASW EE AgbaheA-B “Ue GAQee " pid 7, O92 oO EOLA MO: On OF Res Ngee 
‘ oi ‘ ’ fo ey el : 5 ARE Arg! lh Ayer 50 18 DQO4s ee Oe ase? Oe%r%1 hAgrs pt ey 
PS ae : ba ‘s : Merk agneye ¥ M pay y yt Oe te “6 Bn toke utaas ebeee' Ret ge cesasanss6 9B ma egt 
5. F a) une y pate ay eae es Ke FOhae? aOR Msn 2) S098 Mua sAtan gaze oi dcpeater? 
tn ae au Pele CO oe SE% bets 820 ‘Beatin’ CF pit 0 9110-008 a P aassk te hAh er tee, ips s. AteR Se Te cootee 
. « ’ © ste, @ 8 " ‘ { FO Rady Vens i ORIN DBI Oe bm es on a. Nera ® aw Paco saan Can AGts MALI hoe pipet ee Lhe oe 
U 4 = ae qan : 1 # Byate Aes’ * oa te ASOe whdeda wal 20 faa ge (Pda ori oe ali, * ae Ante itso 
’ i) 7 2 3! 9 hams tb» ’ ashe pt oft 5, P2RR,d fd $s “apthPsse hg: bf mot geet § SS POR ete = Mp4i% Biel Oe, a: 169 Vi ase of ye; Memon ef esac detePocre trarmeat 
A= ® ’ a) ow s Md Be sy 108 > Om iF ane eae tire Se yen ee) | ee Pe Pe i | Oa ey et. Beets kel 34 sbidgtsosogass Bhs ae i} 
! ' AT Cr er nk a 2 4 ® . 4 tr Ye PE eae Throat 0 ee ae © | pone is Ase we OL OODRAN, Chae : er) pre Fatekpo Bel Giehra ate 
. . of ta% ' 1 ® * @ Bt Ay St WERE OMe i Ad wr agtaelt la! nu. DIRE AH. DLO S sor Qacunrtsa segtsna tle agivnd oes ee bd tepde tanh Pel Le 
1 4 r) Cie i v8 t palr ’ a © POs aetteinar essa MA. O 1 i sgt a 4EP8 0 Me 0 p0eM. 4 SOG LAD sAgeauss, Kenkacae ferns eer hse & ites: 
'- ‘ ® ot jes Aout € 6 } Settee Iatto Ade. @s tre'O ot ae talon 8 Nite P andy ohne d:s,1p pe mpaed. ea a oestseout man hat <0. Bye 
s ‘ ee a : u wo Bn 4 BAe WHORE GE she a Pam fy te" a cw er et Chel) Pee) rent ke et a es 020 “tay 
t @. @r ag be : te ' tA 1S BOAT BMA © Ave, Ft * a OOM sahatine $oddor Qasr etsbarsued * ete 
e ' : ae O,F-D 1 Pw U le of AO 0 Aa fh yeh Fat cel PLO CUD these “pee O4eRen At Racrtye 2, 279 
t] “5 ‘ te . ‘ ‘ : % fF tes a3 Fee tee es ore? ewe ye 10f4n Ge shew or.8 cbt: idee te te) Gm Dee: 
. ' L q we fa hd 4 me © eget *eBeley bly 13-4 rPOnO Pee fERGe Apt tees bd, a We gd man bat 1q@e emer 
. ¢ su 1 6 & 4 ee tee sh ay Urhdeg GAPPee as tf es ar als r ery eer ye Yt ae trie ty 
, of ! ’ "a ¢ a 2 & gt 8 AS es ata.s Bihsersre ys ast Hy oe eGawre en “ah fietge ayme pis ew jhe! PA agers 
. ’ . s a 4 “ ve Ae Mm Oregely UA egeer rege" ages é cava, > reoltbrebthebbes SS 
ph ‘h de ' Osos Bos Osh AD pYrtn NH ecunty spade (" # fed oe “Re Og C190, S99. C1469 emp datene Was. 
‘ w 1 ae e + 1 gis 1 Se 8 te Oosnat Site bre 9 le agree Acasw) tg 01 pee e Pttnne. mete ae. Nesutes esate Chg Rann pet RaS Pacmactateg © 
. eich 9 1 ‘oe "ee" e Ont tt a I a ee Oe Ye Mg taver Hoes ri bie pgar8ses + ca agataies 4%. rerevseme ads BAt anne eons 
' ‘ ' 4 ute ate a 48 h In81 yrs © 48'Aiae , ‘yet oe " big Vass: ae “ge sand Spas are de De feraga wea okay Beton, © COTA Saad eves AD Me Senta ncn 008 
aan v ' . 8 goat Wdw es Meakin wapee sya Imet be AWD Boiss Act an A me 1a aharan ee eens tae OLIN A Me rake KAte TRANG enagMs: 
cd ‘ yi : a PE meretye BOR 9 186 mate riipie 120-8 Sat © Heeger 453 ] BN pire. Bae Sets r 
ee ' e1 , 1,10 9 9 wrk sm Ort bende O,  UAy: $08 1aGAale sla 0't Eland 40° 404pm Nee 92 Ag Gw WA, ey ene ata tete biheqone 
. t) ? om 1¢ Qs Aves LP ane © MA AMO 1H arg od MQ ts oe hing Beha hl laaeagy we = Paes vows Pet nde mera ar aiwsees 
te 1 e . Been om &, 1, OY Gewiwls ae 84 Detadetss eer yi) oo! wan aa Tks. DP 5! lle POs. 1 eee ti nths Rae OR sen o 
% v have? wees ae ge ta # fates 98 we Uy a ee oe ant ee eer ety Pee poty 
i ' U co: ae Uf eh Fas f*e mie #4 § Ry AS OE eAgeed ta. Nege hes wie rr FR UNCUM p ghee Pann’ 
5 oreo $4 4g 8'V Pty ot ‘ Lb Ofer © yolhem a des Bd. 3 1 U3ta saa ase me " : 49! Se Rs ap dase ne 
Caeas » get 4 ig ge on & ste'e voared sea, eee a te ub anit 4 Pussy aie, 3 ah ay is Prgeyonce er Bans 
a’ oF « * oe . o € i ’ re 2 ee Verret eee Ce ee oY u“ a 2G UPA MPR’ VED WO. BHO, QOS s OEE Alda seo srathiorel ofae als pitas 
7) ‘ ws gdath Ct ") 68 MN SE wh, $ if aged yaod Ofat Bemange Paee, anne At WAe be 20% Se athlon ase SUSE AT Ce eed. mehey 
’ ta) ee ee ee? | ee ee # "4 alate ble eM, efelaaay ' 4” gegim te 4s Aco le@ aps 2 ply Hpk > Mem, eA 9, PPONaee & ee bo Pp det fa atthe 
. iO ' i r wero? . Se meQ eT 21 1 Eye Bay Top pete pas tg Aa Serhe dt Meron Teabenras a het aguaa et 63 ey Taf 6 Bmp deer Wale pribmecasyase.i aby Be GyAved 
. + = #° ‘ Rt 2 98 = 3 Ose Niuhee wae a Dion Fare whut tgs 320m ee Yyty Beeesn af ahs cagens fotsee: er ques 6 Ones Beda, ©, Baw, EP, od te 
' te) 8 Pio Oi 4 am te 1 1 swae Pt) pear SPS of 45? EA TeRE ONG apa ede gng VO Subs aga 2 UMsae ess ® imimacd o. sade, cope! ba aaa tal Senn ontgdpirvens wit a0 nt) 
1 ay » HAA Ase FF ' sve 5 vent ub fees Pe oe i oo ee ek) | ws oft yn oer aaa | AML mee esestr ag. fe eet lave sent Be eaten ee MP a) 5d ape fle 
. ‘ ‘ Se ode a Ts epste te Rpre ‘ qsbtes a Pregtsess Ane af reer ns Gp Achy apacd bore sya hese gant ae: fem ttre we 268 ER acteamieireR a 
1 s ys@ ar a A gt Siw 48 . LP ey . & oa sie Pat Qt 0 o ie saa Tye Y sig ai P.a8 pag 8 Ae ‘ eR Ae Qe Bp! one Six asteintzen vastus apa PR shee Been 
‘ eee a or ote hae ft) wrt ae te gh tr 8 est gop tone ¢ P F agasn ripe: Cr eerie ‘ea Mam mate ti6 2g, Sigs weit wai Sweet 
a . toe 1 arg \ 2.38 aot era Bis 14 % / oi v ie 6 4inrh ena ® eo tite iis P46 ne we Bi a pe asap Doe Roe 
: . we t » das ‘ es ‘i "$e 8 oh page gt de BEN et LUBE Fe any parage aes ghana Se gts Nor gn 
a a soe bd ee: \ % "0 eas ‘ ay > 3 os steep. 68 Page \ ASA On 2 APM ADYS ey ee cite, Ft 9a Mh Ana te te = Bw 14 
. ’ on » as ' a = ef tes ae a eae ve Pe, oF Y @ s'ame v Sakata Mocs ari tea naNtnte Mel 
fn x 4y oo 2 OD oer ep m& 8 Qe BORE Eire on t Niehafacnzi ies Fe | oF deQimleve t bss 4p ts A Wesewe dS Pon re a4 odds tretaepere acs 
moe mrss ‘ ‘ "fe ad 3et, extn ee ywigs Atys mm feu, ato og ah nent Beh ab "sTaytgt wae & mNehoall MA deme eteg HPO 2 eg weeae chat Tha: 
um 4% 4 fd alee gn oa gr tee oh & et Tet pam et ar) tgy* midete Ueda hat fare an cise eo. ath dh ie. uw es Mya deren 8 m9. wikow a A Sie Geo 
“6 ’ wt ‘ Lee ' 4s Ra enlt Yet fle Sane o's TO yO USTs ae a 6 @ Hage wate Pi 43 Ser air 
1 ' ' & a 258 Ce tel agi , @+ 6.6 Ce s ua eferts eum Aes tr Tf0h ewan Whe: aie. yA tee Mei» 
' 2 aay ey y* @ Vet F s rae ul | yids APA ade 
4 we , ' Si rn 2 i oe eos. uyael, i an UP HE ged pre Aagmm 11, 9 0,8 ater ie ea ; Peery ct fe Baty 
, 4 ¢ & »? °T%9 1 al NS qv tet Or tan ey alg alata ty Hers PANTS, BE Neh aes TEMigre poetics 
. Chee ’ » * A , Phd Po ' . " ean ety ' raph ty pein. Ch Me Alek, 1 yx relent ge Ma &9 Wedadicn, agar peer ey ly ee ees 
> aes . 1 1 4 . f @ Gait: hen ta plug ~ yor as ie Oa Peery f shh, ste ee Te 
. aed ays Sl 28k os ec 6 Rtg 8 Mee Nees Soe YW at esa arty oh 2 gar 30504" “frencageg bea apes aged inser tends Oe isartons 6 
. ’ a 2 e he Tani $ ae ye eo osete ee sehirh “gfarrs ~e antige ig pe bts Wyeth deb) ee, toe ey ctens the Pe Lg pe . 
. . 1 1 . s a i Sadyn t Zga Pa 4 m4 ¥te Sth Wnts tate as ed SE wy ah ae ae by Demet Ash a 180s O58. One kao Hy Peey Pry maaan 
a * f .) F%et oo. ae tay baie PA yy npr toe ayant ttm tpn re Be qaaed eee wt iat orbs fae Seana gms gies 
. ci * 1 ny % . ' sort 4 out fo, * a SUN a « Farry Fae! Per WRN EL Aho pee he vSrepeans ips imacubas ap aeai erage. a 
' Mek eoue } yay us Are ONS Ph ae teoar Shite a repn@ioneng gant: 15 eel ering 9g pipOgetasmans Giver acepeesd rade 
z é * i 8 ’ 6 PA) ¢ f aque £ hie ue $ . oF bole otye guides be Oia 4 OP Ab Fasmra bse xe viet ialeeysg Ratt asdie et 
Peer i t 4 0 fore "s ao tp Poet 4 , a torts. sae ® Hp +04 | Oe Vth maracas eure zu 9 Sena faye vabese” oS 
r ie ' ’ ' v. X i Sate te agers" f sting mos OF oe itn yh Abe Oe Oxty ant Rib ae ps Sree 2 Non Bit Looe, bee ie 
U . x f Syerns im on g “re @%. tga "1 ae tg at 1d tds a ersepeye sts peace 
7 1 oe. & a tha bree Vik ogutes Uae : eka A fares “pee sreparsgs peers %, 
Je . ‘ ae © gee se ; ws i fer pmpe pty te £ END Fag ha ae hat by bia 
. ' @ of * ts a 'f4 » a a a @ ot ey h,as8 ¢ ry af Hp ols es Sele 
8 : » 8 Pore, fat - or "ss 4B, Qsiet eh ge ageae ! . id 1 Wpecte 
* - a) ad eT a “ag Forte, ts fypete 1s os Ste ms Stas sage 72068 ¢ Rawetre PP ae ee 
‘ . ' 1 re f ' : a! i am ri 4 2 PoP & Mae ? a {if pecsee aint ts : Sk AB Baia brag Sp octane eae 
oe ! 4 / ete ay > ye ah ae it lei 6° $2 taph 18 Vik a tO tems Dipeceimigseresicag ah ate orsieeapee re ave e 
=e ae : i Fee ates Hee * 38 { +h wee ui Porat Sse hal. Pal PimeERATP Mea LAdtes> Rene ~paity: register <i eae, 
‘ ts Se 5 ; y sy ‘wu z a enfedinses — tetede fe? fo pl Dal Jed,, saya atte may! habe ZeSe Ey peice Toa: 
A e ’ <b tt bag oe oe ‘rian or eis * S + rhe 8 A hkss PERG Met oede, Med s% Inge { aheegest ae tot bdenint ris 3 88 aoe 
. ae 8 ' gs ls: le & eu sw.e > Epimerates wang sgitafaghead tx okihfa Rig 4! Seattle 
. = ’ aus * a +", pant de Fey wg pe trsete apt ts ers acpepe ae Pir TE a a 
Riga : ays oNeeee, Sener j ‘ ‘ Ped a os ae tN ait hod, 2°; osu at fee Ware © Behe dean g ae 
. 1 e . Pee oweke i f yourts 4 the Gar hte, = “3 Ai ope! arb Spry e Lem: pases a wedtacgian = 
F5 aks at i . 1 1 : ew 1 fi, . RAE a 2 v AmB te de we e S85 bs eh aS aap peg 28e= Pah ty is Sphoade as = 
eee : wie Uw GN late Be > fy at ogusy w+ sey th Pave an =, >, ha phin ts e784 0, >- fy Bphpnpss Sesates CARAS ty 
' See ' 3 i te a FPS = © fy, % «A Sterns Lone hr gathe watnes =the fe t Ateeer vouut pried 
5 “ e : ae San ° F a 1f~% ti ' a % on fot Aspe ee . 2 dave Oa: & i<-o- 093! . Bere 
. . . Se se ee 9 74 Lv et tvs f de ! otek, 4 pi Pe or edie’ Festa outa &. 
' * e 8 a ' . = 40s ne f ioe ages 8” M ai myer age eat seer Reensctas pty ls pierag « 
= z ' 4 ' . oy i 1% a; {" . uu s = 7 5 oe thes i te3 : teh nes ee Rtas pan pels 
: : , ‘oo ‘ ’ o1 of 2S 1d guek los As 3 afr bs saan Taio e Brian amen 
. = : ‘ ’ an is % rs > *: Aue ‘’ Opto ok, Se. tae &, “a hey ip mar ohy wast 
“% = ' > . ae ' ' - nee dinege tel. rents an = ROFee eee eed os eas 
Fa ‘ 4 + A ? ‘* “a oy pipes 
Fi 3 « Hy ae ra 4 * ~ ’ oie eu: Beg hsas “1g "eo ehnden | 3aR aba ka beh, 
£ . ed 2 " % - ’ , 9! Ou 4s ? £ =r err af, uphe jet ve re Preaentedegeaee’ - ¥ 
: . 1 - s' ft y ea° ' ee { on! _™ ale aee vt. Ne re ie Pic EE dd Peer Westie 38% 4 
Eee | , e een 4 . 7H ¥ t Bitsy teas veer 3 as fort GT RS Ps moze: Seo whatge wcSic™ ptaa! 
. o a8 : ai ry ¢ i rar be ie gs * Sh Pten “af: Sess fe z mst 
. x . 1 ° "s ® * ° o one rh * of ” Teyetaat y ap ef + pe ASRS wy 
Tee x . * : Is a a*™ tye F.% 6% if al bil ala oh oh se 5 weseds. oi wesy 
m F ‘3 4 y as% sti Te her hed “he a*e feo t Uae FEe ea ak 
1 . . . . > ' D se . rtd e: % ' a te ae eT ee Te “i ne ee hE ieee Bei 
. . é . e as J « . A ane © / ee sae dine se ms 188s hie efits at 
- S i 7 ee ae . f “By a eee tan ace 3 test i a 
. . * a t t ? ea Pee oe Veit 8 ¥¢ af tA tte Aiete et 
A . ¢ . - Ha woanae aed ? ’ gy ate AY y fate 
#7 ac ' rc f ‘ te Miss il Ka. x 2 
5 ' - : ' A . i A Ape E “si a nes eats lar nae a geaczh © 
oe 8 1 . . ; r ¢ 7 ris sorg f' Pe “sah, 
ee us i ‘ * » . _ he aa 5 a ~ Ea net phot Sf BLE OD ect te 
iy : : ’ : bs 4? be ante * ie Arty ry soe ae F tRsgages ef Re tctches fo cteegs 
. . . TT or s a’ 1 a iv wens : ao Py gta pe 5s ay a @: Vote OCT See H ‘ 
2 : ; ' ; * gt : \ % oe 4 alg gS ses a : tx, « tery ot hive Stats a, oe 
7 rns : wee ? . 1 im ‘ ds apct Farkak oft: ofa "&! 
; : a ‘ ciyFaghe 0 £8 ae 
. . , U Tris id . J . e s . e ve » FA = £6 t. ie bn ade | RFT fast om Ri, 
E Y eC oy 7 Oped ude fee fat! ’ ” ae BAG perl sista 2 th. OF 
' : é i : ' ' a: = 47a aot fo a Fa OSE “i heat ait Sah , 
: pope ed Laer id J ' a Vp eee C) PRO a Roahy agNATd ogtt ° * slats ch, of! 
. hoo * i eke | + ae Ln + 5 os? Sa aie p= E48, ghost Rahat, Teast <n Bee e 
1 ' ¢ oan etat * - ‘tet ’ ty .s “F Rye gt 8 See es ni ¢ 
ra 4 ts « Boe ae 0 - or Sah ARAN 8 ew Be Nate wir, wad 
. . ci ‘ on ee ' AL! 4 » é ‘ rurkek ree 4 . 
La : 5 " sd path bd 1 A ' ‘ = *uhet mig fine i at 
' Die ist nit ‘ ' “ } ; 4 2 “1 2 fF peyt o fn 
. 4 ry H fee ey = ! Fi J; ats Acie: rt 
. . ' , mL 1 ‘os "gira? 2 3 
O } poe q a) a he + ? 
? : ‘ 5 ’ Py 1 
. ' f . Py t , ail § eos i . J 2 
' 1 = e a . J t . rt att ae igh ieee 12k 
. . . . . . 1 . ‘ * “¢g - 5 : 5 . a) * © ig? @ cs 3 = 
7 e as Z ’ “a . : i Ade rn, wend J ro Ay pa aloqgees erties © ps! eo ies ae 
, : / po ; } . wa Pat © Ae ee ; we te Ne caciienat striate are 
1 15 ‘ Ce Ue Up be G ? i Anessa Dh sitiad TS Poe fhe tf 
: on Eee cote & ' 


lee 


ah ome? F3 Ye 
tate ree 5 


it soe 4 tet eave ible Sl rvayret as 
To healed ited ig ’ 
om 
it 
ie eniiee 
op aii ie ap 





, ye fee: 





i P ’ ed ar 
1 1 : ' ' a 1 ta) at ‘ 2 i i, tPF Rest nagvee 





“a" 
ort, ' ry 2 out: 


ove ar pt 
13 Ho te tee ste eae aes h* 
by. Ay oF ee 
; Re | AS wf? me a a ‘dit 
st fs cake ct ge : 
te atiee i “ ea ie a cs ang ere re 
:' D4 . ‘et 2 = wey tilhectadl ded 
a Pita | FP f . | ae rie on Srers vr = Pire®s ypu. 
; 37 ra “ "(See Fane rid lech eagle 3 
F, . a si gio tke Souees Ft Pt re sg ne on oe te r Seqeqetoe surrerasyt: og « [Space 
of, xf cls aiag « : sm yo ¢ *y, 2 fiery 69 23h Oy » ree ere “fre fan ti) a. tA A = pape pact Dd aaa: i ge Eat’ 
aw ~ 18 é’on bo 2 1 of tf ogee ager ge ¥ gets i = sg gees E gt £50 VIR eg 08 aE Ws ae Ege 
i 4 ‘ Lait’. re Ad on oly * us te 1 PAQCNUE.© Ae 0°81 9° owen et wi PTE nas be ia aa ol eine ay Spade 
we, ob, a es Cee ola kee tt Pek oe foes f2 ity oer: ip ane gcagtyenern: wee pe 
Lae #8? tp 7 are eR eset gt = vRVUM, PH" Fle: cntmoras Beste: wig ete ere gis pepe pec 
oes pote de aoe he ets A kes se yal int fh Fn is are) Siar ngs meerae eee seegigey 
*eeF AS) Pprretver, eee Le Pe priate ore pte x 1 cw “geen a fs watnap ire 
ater yg ebat 6 a> ged fap re 
‘ Pi yf * tee he AKC > vpoet y= at Ma ahT dcees oa ok fe Oe ed Lt te a8 Vier ery Pstqe eae 
b Fa%n ial, Re as ow (Bpeatr! melee a gee de cane veer ra Sevay wey regi: ge aes oo ez 
ot 48 ab Pe = it Oe at at aeryrer te) ¢ mate , on le tela tenn ne ny eae ee ra tpn ee -s Soe fe ws 
eae ean » “S82 "0 4 f rehgte a7.7e§ ¢. ? me nie Hants a aay ee ad Peden gi te pe eergese-smirome ge 
55 a 9 5 evi gutter 66 wn @ Bor VM IPS ae eye ‘pyenlene tone ee- = eat ee! pag BER Ae A ge ge ~_) 
16 Fy SntiFe, oh: Mp phos ane GaN: 6 GRO Ope ma: oath ge eee LVR 9 ae wy nape a ws Oem eee Oa REDE yee 
Te =~ od Ec estiper ae . terre Vw Pog wverah ge Asta ew were Biweswo te: gg yeeee fe wee oom 
hate Be yse OTE a “yb #8 Aa 98 ete ewe eheptis~ ey RFhTE, =epes nese terse aaee*** Pipmriaet alla 
1 per ay be eh ee fH pve" tee 1a 2 dasha pa aratinn” Praag patie Eaten ~ riage 
0 SM rtgetia hong oP bd vt = 1 aut Tree, peed Spel fhien et rads a ewe awre 
n 2°? eer oy i Te ee Lo ae oY ie e at le oe ‘ps oF Hh! Pitot eh bs Lt, pee ne we eye 
1 epareet oreiet Te s rhea Ge hlehed 10D over viedo toe MP ere® (Owl wwse cov ran epee en ° 
emule ei ete mn wes Zz SUP & eT a ew o nm fat eae Leak all Putt seal 
i pene a i os ae he er 9948 pep tan ete 90 ba va be8 Bue eRe 2 fre 
40 fon wiis Pate ae of ele fie PTY Oe go gg tai 18 Pps Korte 7 ween DORE RPE oe ot Lat Otome Bes 
Pi ary mete geo O 2 6 YF FRAY te 5 eWNtPrer sme wre why: etry Wile sg egy Seka ago! Stes 2047 om meee BaP Eton me 
5 watson OF vo pritg ts Ve se 0 greg GIO rT yes OW oer 0s thigh ater pe elye ara gh gt *eeerans mpl einen 
ae . , . i 2 1 eee HS! FH (Fel Genes ATS aren g gender atangsee at batt ar tt a sreeerk ay 0 ve Tee SO) Wa ey Coe le wnee SE Pe 
. oe eye at Ohta ew MSR Oh OF atamag weed ON DIGI OTE YO LOT aed dD tye a Hie” Ob TRIES: Cater gh atpeivan acy, da ane 
Betas sire gah sg eSy, wie LENA y* amne % yoceg me ¢ Sister suigint weyereananians 2 Che 0 Bsn) 8 Dera pe es Mg er wee 
ee Mt be Weide yoobys Pets ee emir gherary S42.tr0s gr Bh ge Ca Wet a rayrees, 20 + euaenpe gaye iris Ys WE esgrye, 
5 . ici e Ode ee pedal setae tie atc netet de As dart 909 4 sy peeterata Rene =. ~ 
’ i] 8 ey a p 504 tee fC wsrade TF tes" aip lt etna yere le eleg? swe sige pe {OP oh OTe ied te it xt her re RAT ee 
' . ‘ ry oe 8 Kid : Pee ne ; 1% Brisa chs " ae Cerri ore os ae toad ge y wr oes hi ey Sy Reetey ey Teta. gets 
: i 1 a id mes fh oe 8 Ae Dun ooo Faeyr CHO rier ae yee a iet » seer ae MARIO wy nes eter ® 
1 UJ ' . . 1 . 1 ite ' r) ra STH > wt ee ay Oe a adarye 6 ire. Syr pte HOHE Oy WO pices ae VTP ty gaye. aaueeks bere: geen. of apm peepee aes 
' Pr fa é ' Pa} ee eg « on 0 je otn sort olice eam Ue ee we hy ange eis ereeis r $208 re ete tag Per daiuaeteth 
= ¢ ’ $ i* rm, Pa gk ay Fan) ary od papi cyt Sree ppd Pall sain Ho i ob od v4 62 ee Say Te Tere Ae ee ere 
é . . . ‘ Ao t , © aft it. - 4 w gst 8 ines th (Serge « oR ES 1 Aneel “p elyU one ge SURES ot netekbed we fea aes Eat nde ot Lida edeitleatateleds delete 
t ‘ F & ppow 0h 5g aah ors Oh oS Gh g YS Brrehees ohiaes wiulueweninet see are rt pb as mye Seapine 
‘ A Bode ed es i ee ey Cee Te ee wh qgt pare 00 S8 ya, TPT reds re 
‘ as » 4 eo: wt i 134 far i cerig mS wer ED ney. rg r VRS SEND G MUNA AG Huse AQ eee Errmrvede re reine reeenrcores relations ee i te 
> 1 ‘ ia . care ; + er 4 as Pa ’ : 5 5 tae 6 AIM OY? EMP HOS ve ae ap, Qh AF OAIhy gh 00 ghee oe babech de agli UR e pa’ yom etegier gry ce 
ent . toa Qs . = 1 1 ry i: os ion ae ‘ y Fe “es fine pr 8 Olt gg OF arr reat Prcumycgep mys vise EE ericee mn: mete a Re te” pet 81 Sah Peed re 26 -Ce wT a Oe 
vo 4 4 ' i ‘ee ' jones 5 a ‘ fre SAL ee RTT ee agai td ER ile at het SRI READ i peal A Ph ae dol CO oe baled CO Dae lec tal 
' 1 . . ' »* hed ot Bea 4 a wy wide O64 pusegin tees toy Loaded e.y%e DAg gee! Fe Anaya care S attend ts Sakon re) fers shaker Fate 8 78 
8 ' ' ethos a : . e od ry we 3 en 1 oom 2 Pye tate Pe Beas bed ree gets) “¢e aoe SDS bt Feats potrey: O° we er wer es | 
‘ ts ‘ ‘ 1 ] ‘ s fowt oe 17 a) “ uw wer, oreumtas POP 0S ag Pa ew pie Ler OCF yw shat sea Tew eer 91) 0s erat Bey eady wate: 
; : ; ctaus pt ICKT Lo A me prul Oe wats MeL soe Bevan reltatat 2G? gta C4 coe OLD RADA MG BAN ale eytir ak ON 90 Rei 
C1 Peet AA ey Fw Oy TAT ORR Qe: gh FRO Ne 49-4 rel oe! oe ees 40ee 041 aus rye se teepoyprets! 
hd, pirate? «md Yr ees aevTe wh ae es te ae cotierteg a pene facial enlvnhainivaafeied 
A 
































Ft q@ s+» 



























a 
- 












7S, 




































eututae = uti eer Grom Y sett) eve eee 5 CHOY © FRU Ore eeRey awe PHP gO 
irae ee pe gust rue ms lid Mcgee? ke Wad i db heres ya stare aamamen ore Pt a8 rt a ea RY 
serene 0 OH np ode ae Pe a a i Viale Ds TeV AERO or 8 ORY PS TER Ory Age 
. Ty gna ates bly cha" peace ar CT Lt all eit ae pry te ee Fe Gee Beh YOu ew er, Cheb heF 
HGP pee yn Hehe e8 cay 1 ese ALA aah tS omit est 9) Fo DI BOLE TOE Yell ang y EEO e 
pane tng Nae (settee eorebe sf rniimarmepvn baer tearon aatrest eben bate egos 
w™ 6 6 eo needes Vente we a0 ca a 4 x ory we wate 
4 2 was rere. Fete eh yee 9 Geary Lae enh oat! POVIRWIF IO ES OI Gray igm > yeLo ET FA) Tera here grees 
oak tr oe sa Af de OAL ds foe Fat ae bErar 8 Ld or bape Sralmasentes Pee. ieee eet tat Far Pago 
Fwy enlev! atar Peet testis bos ak Loree. gnc ia he ee eee ar ht ee eet Meter te 
re: Fer gto re ug shem v: Tg pPasr eget aa nes 9 a Ee RAs & OV Getens Meer wrtiewst worm preree sages A ed eh Se eee 
i ay FOP may h 2 0 e p erty e ts 2 HUM THT i a nme ML vended. of de BOUTS 90 AMTRES ght WP Ory BO Fas yTe | OTe 
mad rere We QOMD 8 6 Ur et ion tl Penta® were r “4-9 ya ae ew ey OR eet re te ee ee LT er Pere 
wren steer" ony uy a8 91 BON aga Fee” NOY “Ew OE TG CUS PIL GH wet @ FSG TES FTE W OPT Y eg eG eR On lnr cha Tse 
- my a a Dl orth atv poled yactetyrnes et hal Sed be fal Li pect tg adic Rach ened Wy ees STR eee! 
wi" hope 408 ay nae Bet r-8 9 9- Ae tern Bathe Od et tet Toh tk weg rrtpadvacyouy yorvemtens 2 er 
0 a 489 Op hts Tis Moin ee teh ade 5 Sh Sit ed dae a bee Al) he a dee atk bb ee chien atid tee 
acheatte urate seeds beh dh alae So, hy wa ee aowont yee on C198 g CRY ora eee SP wl we Ale h se TD nee Geprg! FOEO TE 
Prana Pt ak ete Meek be thas hie nate SVC Og UW byrie Eta" GIES FYFE TG HA bo 54.04 TAT LTR 
staberon at 0 he ont, bef EMUFRID VAD ANE Pw Krew et ager eniueaiores PATEL GPR ANOET B® PROP Y FE. Bg tees Tals tary 1968 ve 
pratt’ oes = he Ot ronw V0 ePPAeg? ME OPES Ome eeegeT prelate brad te to tas att ae oh be Lies ne 
yt Rae Resse anne ce EP Oe UG CUS IM AH artes the 3 bs ee | 
1 ~ es Merwe fim Wey gt TER MERLE OP RG yeNINeN Hh CB -wONd arweecuN: 
C4 Sratate’ GEE Bae ears pe bk po eign do oF y pire Sryreresesere-> @Woerrwower ee 
. OP ee 08 wh ee rer settee GY oF High ae Partita taht “eet pry geye gevequitn saw el coves vervewrvoevere te 
’ - ' <= oF 1 Nery gob oy “gto ye ow Tal ha) 4 i ee ae See ary Ted rs) iad Greet RR 2 yet ora Ke 
- i os oI Melee Saga ws gst WA Vout ie Ld warts Sprickwareens 49 9 Srl ws CY uy VE™ coae 
% 0 oO Bate ehaae o> Eee seme eee fewrttonmer te el Ot We awe 90 rE wat 


ww 
Sah uo a) be ba.) fs Fp 266 ee ae VII pee 
* -_ RRA Eres eg eiveieanmenpesn tl 


ae wm te MP YM et, 
wr ee eh A a aprender . RS St WA vasbieresy: 

y fo a WhO Sworaty oxy Ore 
ies rion ree re TE ey vee we ere prems 


aw Poh oy WIR. 2h) Woe Paar ure Cal ea" t¢ 
ee hae. Lip Saati “aa eage ef eae Re Po yore Ore 
7 mS a [Th et Le eed Ce 4 sane A ene E Gare 
a OF PUTS AT HHT tere pie Brats Ths Busey eae pi uetese hanks debe 
POO ar ma a Sa aaa bt MI ba oe poe oath ns ak ate Li Poe Oe he Ges 
bors dal ta oe iit seers! 2H95 Beers: Keita for wie ao ae At Pe i be) aoont sens eens vavoourure see 
“a Bex erz} 4 <7 PQA TE Yyeo rer 
Ricticcinoeumbes 
























bat Oros anette 

ete ok Cd Tada bh Mash aca be Nour! tele eer 

ee] aye epee ELrittt vevegre als BNE Erg etertgran's wees ee tered ae 2 eRe re Ey Hy 
SQW 199; Ce pe te7ts NRE vee earenarac te Siuepues: 9283 tb Phim Sehr Oes wel M8 re 

SRS , ogetey cenir' be hie to PD BEY: ad Owe & pyar weearire ys 

ws srs OR * erry I) Lk hee ok ey op Oelt oa ty Any ghbe e- yae 

hy rede ep LATE patel), wires Ls ps Rete) 

a Pe A a arth (Gt yt eg an Ths Pera % a han) 

Pie yaa, iene be leh Mb ad ake 52 Saad Sey rk tire woe ry 4 tek Ae Lae ok Ol bi te ie ota kee ae ce om an as hea 9 

note 3 1ot9 he, Fe Hen SIR A Deh laoel bye Der bal La dade to dL 

Prat: Nic ree nhs Pa ese) ams crates cat eaten 

iia 





RLY, GALISTIRALA 85545-800¢ 
7 











NAVAL POSTGRADUATE SCHOOL 


Monterey, California 


EXPERIMENTAL RESEARCH AND EMPIRICAL TESTING 
OG, Dist Pre Ui DeaGRhOUr SpECES LON 
SURO Rt Soyo LEis 


by 


Cindy Clark 


and 


R. Warren Miller 


June 1989 


Thesis Advisor: James E. Suchan 





Approved for public release; distribution is unlimited 


TO) I) Ncsy 





UNCLASSIFIED 
URITY CLASSIFICATION OF THi3 PAGE 





REPORT DOCUMENTATION PAGE 


REPORT SECURITY CLASSIFICATION lb RESTRICTIVE MARKINGS 


Ls UNCLASSIFIED 
SECURITY CLASSIFICATION AUTHORITY 






3 DISTRIBUTION / AVAILABILITY OF REPORT 


Approved for public release; 
distribution is unlimited 






DECLASSIFICATION ‘DOWNGRADING SCREDULE 


PERFORMING ORGANIZATION REPORT NUMBER(S) 5 MONITORING ORGANIZATION REPORT NUMBER(S) 





NAME OF PERFORMING ORGANIZATION 6b OFFICE SYMBOL | 7a NAME OF MONITORING ORGANIZATION 
(if applicable) 
aval Postgraduate School Code 54 Naval Postgraduate School 


ADDRESS (City, State, and Z/P Code) 7o ADDRESS (City, State, and ZIP Code) 


mterey, CA 93943-5000 Monterey, CA 93943-5000 


NAME OF FUNDING: SPONSORING Bo OFFICE SYMBOL 
ORGANIZATION (if applicable) 


9 PROCUREMENT INSTRUMENT IDENTIFICATION NUMBER 





ADDRESS (City, State, and Z!P Code) 10 SOURCE OF FUNDING NUMBERS 


PROGRAM PROJECT TASK WORK UNIT 
ELEMENT NO NO NO ACCESSION NO 
TITLE (include Security Classitication) 


PERIMENTAL PESEARCH AND EMPIRICAL TESTING OF DISTRIBUTED 


PERSONAL AUTHOR(S) 
lark, Cindy and Miller, R. Warren 


y TYPE OF REPORT 13b TIME COVERED 14 DATE OF REPORT (Year, Month, Day) [15 PAGE COUNT 
aster! s Thesis FEOM TO 920 — 


SUPPLEMENTARY NOTATION | . — 
1e views expressed in this thesis are those of the authors and do not reflect the official 


policy Or position of the Department of Defense or the U.S. Government. 
| COSATI CODES 













18 SUBJECT TERMS (Continue on reverse if necessary and identify by block number) 
_FIELO GROUP SUB-GRO' ? Distributed Group Decision Support Systems (DGDSS); 


—_— | Grouv Decision Support Systems (GDSS); Decision 


rT ™~é“<—‘*sS”~”~””COC”C~C~C*#SY,« SUpport Systems (DSS): Distributed Systems 


ABSTRACT (Continue on reverse if necessary and age: by block number) 
Past research in the area of Group Decision Support Systems (GDSS) has 


ttempted to ascertain its future potential in the business world. This thesis 
xtends the GDSS research to the area of distributed Group Decision Support 
ystems (DGDSS). An experiment was performed where groups of three and four 
e@rsons were tested in different croup decision making settings, a traditional 
2cision room and a DGDSS. 


| An experimental prototype DGDSS program, developed at Claremont University, 


laremont, CA, was evaluated during the experiment. The experiment pointed 
at Peeral program advantages and disadvantages during the evaluation. 


q 


: The study determined that use of the DGDSS resulted in generation of 





Meg@er Numbers of criteria and alternatives and greater decision satisfaction. 
SDSS supported groups experienced: less commitment to the final decision, 
| DISTRIBUTION / AVAILABILITY OF ABSTRACT 21 ABSTRACT SECURITY CLASSIFICATION 


5 UNCLASSIFIED/UNLIMITED (() SAME AS RPT [J otic USERS Unclassified 


3 ee ELE NOM OU 22b TELEPHONE (Include Area Code) | 22c OFFICE SYMBOL 
ees. E. HOG) Br G@DeWs Code 54Sa 


A 
; FORM 1473, 84 MAR 83 APR edition may be used until exhausted SECURITY CLASSIFICATION OF THIS PAGE 


Allother editions ar { 
other editions are obsolete f2U.S Government Printing Office: t986—606-243 


1. UNCLASSIFIED 


UNCLASSIFIED 


SECURITY CLASSIFICATION OF THIS PAGE (When Data Entered) 


#19 - ABSTRACT - (CONTINUED) 


less satisfaction with the decision process, and 
less satisfaction with communication. 


S N 0102- LF- 014-6601 
Tat WichLASo LE LED 


TTT 
SECURITY CLASSIFICATION OF THIS PAGE(When Data Entered) 


Approved for public release; distribution is unlimited 


Experimental Research and Empirical Testing of 
Distributed Group Decision Support Systems 


by 


Cindy Clark 
Lieutenant, United States Navy 
B.S., Jacksonville University, 1981 


and 


R. Warren Miller 
Lieutenant, United States Navy 
B.S., Adams State College, 1981 


Submitted in partial fulfillment of the 
requirements for the degree of 


MASTER OF SCIENCE IN INFORMATION SYSTEMS 
from the 


NAVAL POSTGRADUATE SCHOOL 
June 1989 @ 


FF4KDTSG 
fi YA “> 
9 OR ) 74 
ABSTRACT 


Past research in the area of Group Decision Support 
Systems (GDSS) has attempted to ascertain its future 
potential in the business world. This thesis extends the 
GDSS research to the area of distributed Group Decision 
Support Systems (DGDSS). An experiment was performed where 
groups of three and four persons were tested in different 
group decision making settings, a traditional decision room 
and a DGDSS. 

An experimental prototype DGDSS program, developed at 
Claremont University, Claremont, CA, was evaluated during 
the experiment. The experiment pointed out several program 
advantages and disadvantages during the evaluation. 

The study determined that use of the DGDSS resulted in 
generation of larger numbers of criteria and alternatives 
and greater decision satisfaction. DGDSS supported groups 
experienced: less commitment to the final decision, less 
satisfaction with the decision process, and less satsifac- 
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I. INTRODUCTION 


In the past 30 years, information systems have evolved 
into an essential part of the business environment. 
Regardless of the nature of the business, private or public, 
the demand for greater amounts of real-time, accurate, and 
relevant information is growing. Unlike the past, where 
having access to this type of information resulted ina 
significant competitive advantage for a business, rapid flow 
of information is now a necessity just to maintain a 
strategic position in today's technologically advanced 
society. 

The proliferation of available information systems with 
wider varieties of functions and the vast improvements made 
in these systems are events that have acted to spur the 
increased demand for information. The old data handling 
systems such as the typewriter, file cabinet, and many 
manual recording processes have been replaced in most 
businesses today by modern information systems, known as 
Management Information Systems (MIS), that are capable of 
gathering, manipulating, displaying and storing the same 
data that had been previously processed by the older 
systems. Other types of information systems include the 
Expert System (ES) or Artificial Intelligence (AI). Unlike 


the MIS, ES/AI's have been developed as specific decision 


making information systems. To elaborate further, an ES/AI 
is developed as an information system which incorporates the 
knowledge of experts, on a specific subject like trees, gas 
engines, or electrical circuits, in order to solve problems 
posed by a user. A person tackling a problem pertaining to 
the subject the ES/AI is built to answer can submit the 
question to the ES/AI for a solution. 

Between the Management Information Systems, and the 
Expert Systems ends of the information spectrum is a third 
information system currently referred to as a Decision 
Support System (DSS). 

Like MIS, DSS characteristics include the ability to 
gather, manipulate, display, and store data. However, DSS 
is different from MIS in that DSS is capable of assisting 
the decision maker in semi-structured problem solving. Keen 
describes DSS as: 

..-interactive systems frequently used by individuals with 
little experience in computers and analytic methods. They 
support, rather than replace, judgement in that they do 
not automate the decision process nor impose a sequence on 
the user. [Ret. i:p. 48) 
On the other hand, MIS is only capable of performing highly 
structured, routine and repetitive functions for which it 
was programed, like periodic report generation or 
registering passengers on airlines. 
Both DSS and Expert Systems are used for decision 


making, but a brief contrast of the two will show why Expert 


Systems can not be considered Decision Support Systems. As 


mentioned earlier, DSS is intended to complement, not 
replace the decision-maker. On the other hand, once 
sufficient information has been entered into an Expert 
System, it is designed to make the decision for the 
decision-maker and in many cases issue appropriate 
instructions once the decision has been selected. An 
example would be a medical diagnostic system. 

Unlike an Expert System, the DSS does not possess or 
contain knowledge obtained solely from experts nor is its 
focus narrow and specific to one interest area such as 
medical diagnosis. A DSS may be linked to corporate data 
banks which allow extensive use of a wide variety of data. 
This allows the DSS to assist the decision maker ina 
variety of decision problem areas. A DSS also allows the 
decision maker to project the consequences of potential 
decisions by the use of "what if" queries. 

A DSS may be designed to assist one decision maker 
(individual DSS), which is currently the most common type of 
DSS. DSS technology is also being used to support group 
decision making. These systems are referred to as Group 
Decision Support System (GDSS), and are defined as follows 
by Bui and Jarke: 

A group DSS can be defined as a computer-based system 
that aims at supporting collective problem solving. A 
collective decision-making process can be viewed as a 
problem-solving situation in which there are two or more 
persons (i) each of whom is characterized by his or her 


own perceptions, attitudes, motivations, and personality, 
(11) who recognize the existence of a common problem, and 


(iii) who attempt to reach a collective decision. ([(Ref. 
Bie Sie 


Although GDSS is a little known concept to most business 
environments, it has the potential for making a significant 
impact on how, when, and where future business decisions 
will be made. More emphasis is being placed on efficiency 
in handling information in order to gain a strategic edge 
and achieve operating efficiency. There will no doubt be 
great expectations for Information Systems experts to 
provide the kind of quality products that society has become 
accustomed to. In addition, the trend in the private sector 
1s towards a growing number of conglomerates relying upon 
groups of individuals to make decisions about corporate 
strategy, planning, and crisis resolution. 

In this future business environment, group decision- 
makers many not always find themselves located in the same 
room, building, or even the same geographical location when 
the need for a decision develops. Although the cost 
associated with bringing together geographically dispersed 
decision makers may be viewed by some private sector 
businesses aS insignificant when they consider the quality 
of decision obtained, this feeling is not shared by the 
public sector. With public sector budgets growing tighter 
each year, even the smallest over-looked opportunity for 
cost saving can receive wide scale public attention. It is 


in this geographically dispersed and cost conscious decision 


making environment where there is a need for real-time, high 
quality decisions. The GDSS has the potential to fill this 
need and thus have a favorable impact on the private and 


public business sectors. 


A. BACKGROUND 

Research conducted on Group Decision Support Systems 
(GDSS) has attempted to identify its future usefulness in 
the business world. The various perspectives on the 
different aspects of group decision making: decision 
quality, decision satisfaction, number of alternatives 
generated, and decision confidence, have been investigated 
by such authors as DeSanctis, Gallupe and Dickson [Ref. 3], 
Turoff and Hiltz [Ref. 4], Van De Ven and Delbecg [Ref. 5], 
and Tattersall [{Ref. 6]. The significance of these aspects 
cannot be overemphasized when evaluating a GDSS. Some of 
the reasons are: 

- If GDSS use results in better decision quality, as 
well as measurable assistance to the decision makers, 
then it can be perceived as a benefit. 

- If the GDSS increases users satisfaction with the 
decision-making environment and process, decision- 
makers will be more likely to use the GDSS for future 
group decision making sessions. 

- If the GDSS can produce an environment where decision 
makers feel free to introduce new alternatives and 
criteria without fear of reprisals from the other group 
members, there is likely to be more alternatives 
generated, which will increase the possibility of a 
better quality decision. 

- If GDSS use results in high levels of decision, 
decision-maker satisfaction and confidence, then 


satisfaction and confidence will lead to stronger, more 


5 


committed and more dedicated implementation of the 
decision. 


In addition to the above mentioned decision making issues, 
system design characteristics and decision task types--for 
GDSS decision making--have been investigated by such authors 
as DeSanctis, Gallupe and Dickson [Ref. 3], Turoff and Hiltz 
[Ref. 4], Gray, Aronofsky, Kane, Perkins and Helmer [Ref. 
7], Huber [Refs. 8, 9], DeSanctis and Gallupe [Ref. 10], and 
EDP Analyzer [Ref. 11] for purposes of evaluating GDSS 
potential. Furthermore, research conducted by DeSanctis and 
Gallupe on the different types of decision making 
environments have led to four categories of future GDSS 
usage. They include Decision Rooms, Local Decision 
Networks, Teleconferencing, and Remote Decision Making [Ref. 
10:p. 195}. 

Past research of all GDSS characteristics: decision 
making aspects, system design, decision making problem type, 
and decision making environment, demonstrates that there is 
a future for GDSS in the business sector. Since there are 
many different organizations having different needs, and 
many combinations of user services that can be provided by 
GDSS, it is necessary to continue the research for finding 
the best match of user organizations and GDSS. This study 
will attempt to further the research of GDSS by 


investigating the development of a Distributed Group 


Decision Support System (DGDSS) for use in business 
organizations with geographically dispersed decision makers. 
DGDSS has been referred to by DeSanctis and Gallupe as 

"remote decision making" and is described as: 
..- uninterrupted communication between remote "decision 
stations" in a geographically dispersed organization which 
has a fixed group of people who must regularly make joint 
decisions....This scenario...removes the constraint of 
meeting location and addresses the needs of decision 
makers who must work together on a regular basis. ([Ref. 
10:p. 197] 

The most significant difference between a DGDSS and GDSS 
is that group members are physically removed from each other 
and are therefore dependent on a communication facility to 
interact with each other. Some other characteristics of a 
DGDSS environment are reduced peer pressure, structured 
communication, more task oriented communication, less 
concern with meeting location, and anonymity. The question 
is whether these characteristics lead to better decision- 
making and better decisions. Current research and 
development in the area of distributed group decision 
Support systems is virtually nonexistent, and systems that 


are being tested are still in the fledgling stages of 


development. 


se SUMMARY 
This paper will extend research in the area of GDSS by 
evaluating the development and testing of an experimental 


prototype DGDSS software program developed by ADJ Professor 


Ben Mortagy at the Naval Postgraduate School in Monterey, 
California, in conjunction with Claremont University, Los 
Angeles, California. 

This research will attempt to answer the following 
questions: Which DGDSS user capabilities are most 
desirable? Which are most needed? Does the design of the 
DGDSS enhance or disrupt the decision making process? Does 
the DGDSS have the potential to provide better decision 
quality and increased decision maker participation? Can the 
DGDSS be improved to provide better assistance to decision 


makers in a distributed setting? 


fe Pe RALOURE REVIEW 


Considering that a Distributed Group Decision Support 
System (DGDSS) is a type of Group Decision Support System 
(GDSS), an in-depth look into the research conducted to date 
on both GDSS and DGDSS is appropriate. Furthermore, since a 
GDSS is very similar, but with some notable differences, to 
a Decision Support System (DSS) in its components, a brief 
discussion of DSS will be included at the beginning of this 
chapter. It will be followed by an expanded definition of 
GDSS. This GDSS definition will lead into a discussion of 
GDSS theory involving the following: 

- GDSS Configuration. 

- DGDSS, A Type of GDSS. 

- Design Framework. 

- Design Strategy. 

- System Capabilities and Levels of Support. 

- Task Type/Degree of Difficulty. 

= information Sharing. 

- DGDSS Communications. 

=. DGDSS. 
This literature review will conclude with a discussion of 
previous GDSS empirical studies which relate to the current 


study. 


tae DSS 

Although there is no agreed upon definition of a DSS, 
there is consensus among researchers that a DSS does differ 
measurably in at least two ways from its predecessors. 


Although a brief DSS definition was furnished in the 


Introduction, an additional, more involved DSS definition is 


now appropriate: 


.--a DSS is not merely an evolutionary advancement of EDP 


and MIS, and it will certainly not replace either. Nor is 


it merely a type of information system aimed exclusively 


at top management, where other information systems seem to 


have failed. A DSS is a class of information system that 


draws on transaction processing systems and interacts with 


the other parts of the overall information system to 

support the decision making activities of managers and 
other knowledge workers in the organization. [Ref. 12:p. 
124 


The first major difference is ina DSS's ability to 


interact with both the decision maker and other parts of the 


information system to assist the decision maker in problem 
solving. The EDP/MIS has the ability to display, retrieve, 
store, and manipulate data. Capabilities like these are 
useful if the system is designed to assist the decision 
maker with problems that are very structured, but are 
insufficient if the problem is semi-structured or 
unstructured. Gorry and Scott Morton define structured, 
unstructured, and semi-structured problems as follows: 

A fully structured problem is one in which all three 


phases--intelligence, design, and choice--are structured. 
That is, we can specify algorithms, or decision rules, 


that will allow us to find the problem, design alternative 
solutions, and select the best solution....An unstructured 


problem is one in which none of the three phases is 


structured..."semi-structured" decisions [have] one or two 
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of the intelligence, design, and choice phases 
unstructured. [Ref. 13:p. 63) 


An example of a structured problem 1s calculating the 
interest rate on a credit account. The original amount, new 
amount, and elapsed time are known. Embedding this 
information in an algorithm within the EDP/MIS will produce 
the interest rate. The only real assistance provided by the 
EDP/MIS is the calculations. On the other hand, a DSS could 
assist with this problem as well as problems not having a 
standard algorithm to use or problems having more than one 
possible solution, like purchasing the product line for the 
next year. 

The second difference between the DSS and EDP/MIS is in 
the hardware/software components that exist in the DSS. 
Sprague (Ref. 12:pp. 12-3] explains that the DSS is composed 
of three levels of technology: Specific DSS, DSS Generator, 
and DSS Tools. He goes on to define a Specific DSS as "the 
system which actually accomplishes the work," the DSS 
Generator as a package of hardware/software which provides 
the capability of building a Specific DSS, and the DSS Tools 
as the hardware/software elements which assist in the 
development of a Specific DSS or DSS generator. Sprague 
(Ref. 12:p. 20-5] provides a conceptual model of the DSS's 
Database subsystem, Model base subsystem, and User System 
Interface subsystem that displays the technical capabilities 


a DSS must offer. 
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In contrast, the EDP/MIS hardware/software components 
can vary depending on organizational use of the system. If 
the EDP/MIS is used primarily for data receiving, storing, 
retrieving, and reporting, it will have a database 
Management system (DBMS) component. It may also have an 
interactive modeling component which will store a variety of 
programs that can be used for data analysis. The system 
will also have some type of dialogue component so that the 
user can interface with either a DBMS component and/or the 
interactive modeling component. Unfortunately, unlike a 
DSS, in an EDP/MIS system the components do not interact 
independently with each other. For a model to use data from 
the DBMS component, the data must be first taken out of the 
DBMS component and then programed into the model by the 
user. 

This brief contrast of EDP/MIS with DSS capabilities and 
components is needed to present the similarities and 
differences between DSS and GDSS. Huber defines a GDSS as 
"a set of software components, hardware components, language 
components, and procedures that support a subset of the 
potentially supportable group tasks." [Ref. 8:p. 438] The 
GDSS is surprisingly similar to a DSS in that it also 
contains a model base, database, and interface requirement. 
The difference results from the additional necessary 


features in the GDSS. 
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Turban (Ref. 14] lists these features as a communica- 
tions base, enhanced model base to accommodate group 
consensus needs, greater up-time, expanded physical 
features, and increased setup before use of the system. He 
further claims, however, that when all the added features 
are removed from the system and the number of members using 
the GDSS is reduced to one, the GDSS becomes just another 
DSS. The similarities and differences are nonetheless very 
distinct, with the main difference being in the type of 
decision making, individual or group, the system is created 


to serve. 


B. GDSS CONFIGURATION 

Since the GDSS is created to assist a group of decision 
makers, the concept of adapting the GDSS to the decision 
making environment is very important in the design of the 
GDSS. In contemporary organizations, a group decision 
making environment can take the form of members coming 
together in a conference room with a table and chairs, or by 
telephone in either a conference call or teleconference 
situation. A GDSS can mimic both of these configurations 
and offer two other configurations as well. 

DeSanctis and Gallupe [Ref. 10] describe four categories 
of GDSS configuration: Decision Room, Local Decision 
Network, Teleconferencing, and Remote Decision Making, which 


can be designed for organizational group decision making. 
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1. Decision Room 

In the Decision Room, decision makers are seated 
around a horseshoe-like table with a computer terminal and 
monitor in front of them. Communication between decision 
makers can be verbal or by the message capabilities of the 
GDSS. There is a public display screen to display and 
highlight member's inputs and group data. A facilitator may 
be present to operate the system. The advantage of the 
Decision Room is speed of processing information coupled 
with the ability to manipulate and display the information 
to the group members. 

2. Local Decision Network 

The Local Decision Network provides decision makers 
with a computer and terminal in their work-space. Group 
members never have to leave their offices to hold a decision 
making session. As DeSanctis and Gallupe explain, "A 
central processor would store common GDSS software and 
databases, and a local area network would provide member-to- 
member and member-to-central-processor communication." 
(Ref. 10:p. 196]. All communication could take place 
through the GDSS's message system. Displaying of public 
data and results can be accommodated on the individual 
computer terminals. The advantage of the Local Decision 
Network is flexibility in both meeting time and place. This 
does have a disadvantage of no face-to-face communications 


which may be very important to some individuals. 


14 


3. Teleconferencing 


The third category of GDSS configurations is 
Teleconferencing. Unlike the teleconferencing done by a 
telephone utility, in GDSS teleconferencing "two or more 
decision rooms are connected together by visual and/or 
communication facilities." (Ref. 10:p. 197} This system 
has the advantage of reducing organizational cost when it 
comes to travel and increasing flexibility in time and place 
of meeting. 

4. Remote Decision Making 

The final category is Remote Decision Making. 
Although not as well known as the other three categories, 
Remote Decision Making may have a real future as more 
organizations become decentralized. With this type of a 
configuration, decision makers are geographically dispersed 
in remote areas. Decision making is done in an environmen- 
tal setting similar to the local decision network with 
decision makers having their own computer and terminal at 
their work-stations. Communication between decision makers 
is accomplished through the GDSS's message system. All 
public data and results are displayed on individual computer 
monitors. Remote Decision making is advantageous for 
reducing travel cost and increasing flexibility in meeting 


time and place. 
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Cy DGDSS._A. TYPELOH Gpss 

The Remote Decision Making configuration is the type of 
GDSS that this research has focused on. A Remote Decision 
Making GDSS is defined by DeSanctis and Gallupe as "uninter- 
rupted communication between remote ‘decision stations' ina 
geographically dispersed organization which has a fixed 
group of people who must regularly make joint decisions." 
[Ref. 10:p. 197] 

In this study the Remote Decision Making GDSS will be 
referred to as a Distributed Group Decision Support System 
(DGDSS). A subsystem of the GDSS, the DGDSS supports 
organizational group decision makers who are geographically 
dispersed but in fixed locations. The DGDSS supports group 
decision making tasks through asynchronous and/or real-time 
Wide Area Network (WAN) or Satellite supported computer 
mediated communication. 

Since little research has been done on the DGDSS, 
previous research on the GDSS that pertains to the DGDSS 


Will be examined next. 


D. DESIGN FRAMEWORK 

With any GDSS or DGDSS created, the system designer must 
decide how the system should be created. Criteria 
considered in designing a GDSS include: group size, member 
proximity, usage of the system, members' expectations of the 


system, necessary capabilities and level of support of the 
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system, category of GDSS, task type and degree of 
difficulty, and the system delivery mode. By examining 
these criteria, the designer can create any of the GDSS 
configurations previously discussed. 

Although most of the above mentioned criteria must also 
be considered when designing a DGDSS, only those which 
relate to the present study's research questions will be 
addressed. The following research questions pertain to the 
design strategy and capabilities and level of support 
criteria: 

- Which DGDSS user capabilities are most desirable? 
- Which DGDSS user capabilities are most needed? 


- Does the design of the DGDSS enhance or disrupt the 
decision making process? 


- Does the DGDSS have the potential to provide better 
decision quality and increased decision maker 
participation? 


- Can the DGDSS be improved to provide better assistance 
to decision makers ina distributed setting? 


Since the task type/degree of difficulty criterion has a 
direct impact on the capabilities of the DGDSS, it will also 
be addressed. Additionally, because the purpose of the 
DGDSS is to assist geographically distributed decision 
makers who may have no immediate recourse if the system 
fails, two extremely important capabilities, information 
sharing and communications, will be discussed in depth and 


separately from capabilities and level of support. 
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aye DESIGN STRATECHES 
After all of the criteria for the DGDSS/GDSS are 
examined, a software design strategy can be selected. 
Various design strategies have been investigated in previous 
GDSS research. Major strategies include: Technique/ 
Solution Driven, Task Driven, Integrative Approach, and 
AcEIVvity, Driven. 
1. Technique/Solution Driven 
The Technique/Solution Driven strategy supports a 
specific or a limited number of group tasks. Huber has 
assessed research institutions and corporations using GDSS's 
created with a Technique Driven design strategy: 
...-1it appears that either the entrepreneuring organiza- 
tions behind these systems have already segmented the GDSS 
market...or that individual GDSS designers approached 
their design task with a decision-aiding technique in mind 
that followed more from their disciplinary backgrounds 
than from a careful review of the tasks faced by decision 
groups. [fRefs. 8:pp. 437-8; 9: pao 
Huber goes on to point out that the main disadvantage with 
this strategy is that the GDSS is limited as to the tasks it 
can support in the organization [Refs. 8,9]. 
2. Task Driven 
A designer using the Task Driven design strategy 
would examine the users! tasks and then decide on the best 
kind of system to support these tasks [Refs. 8:p. 440; 9:p. 
200]. DeSanctis and Gallupe categorize various tasks by 


group decision goals [Ref. 15:p. 600]. The category of 


generating ideas and action would include planning and 
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creativity tasks. The intellective and preference tasks 
would fall under the category of choosing alternatives; and 
the cognitive conflict tasks and mixed-motive tasks would be 
in the category of negotiating solutions. In addition to 
the tasks associated with problem solving, Huber describes 
another possible set of tasks where the "decision group may 
serve as 'reactors' to descriptions of decisions tentatively 
made, as information generators, as recommendation 
generators, or as autonomous decision units." [Refs. 8:p. 
440; 9:p. 200]. An advantage to this type of design 
strategy is that it is not specialized nor specific but 
open-ended in its capabilities. The disadvantage is that it 
is not realistic. There are too many combinations of tasks 
that any given decision making group may actually be 
involved with. 

3. Integrative Approach 

The Integrative Approach design strategy stresses 

the need for considering the behavioral as well as technical 
issues in designing a GDSS. Developed by Beauclair and 
Jelassi [Ref. 16], the Integrative Approach addresses 
certain behavioral issues, such as diffusion of responsibil- 
ity, deindividuation, pressure toward group consensus, and 
problems of coordination. These behavioral issues can 
negatively effect the success of group decision making if 
not considered during the design phase of the GDSS. If the 


system designer acknowledges these behavioral issues when 


IS, 


designing the GDSS, he can incorporate into the GDSS 
appropriate countermeasures to prevent these negative 
characteristics from impacting group decision making [Ref. 
16]. 
4. Activity Driven 

The Activity Driven design strategy focuses on group 
activities (information retrieval or generation, information 
sharing, and information use) rather than on group tasks 
(Refs. 8:p. 440; 9:p. 200]. Suchan, Bui, and Dolk support 
the use of Activity Driven design strategy and state "GDSS 
design strategy should focus on general group activities 
rather than trying to identify and support all possible 
group tasks. These group activities are identified as 
information sharing, use, and analysis." [Ref. 17:p. 443] 
This strategy's advantage is that each possible activity 
that a decision group could be involved in is considered. 
Additionally, the technology exists to make this design a 
feasible option for an organization. The only disadvantage 
is that it may not be as specific in its capabilities as 
some users would like. 

5. Combining Activity Driven and Integrative Approach 

The DGDSS software used in this study is designed 
using a combination of the Integrative Approach and Activity 
Driven strategy. This study will further DGDSS research on 
how the software design strategy enhances or disrupts the 


decision making process. Similar to the GDSS software 
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"Decision Aid for Groups (DECAID)" used by Gallupe, 
DeSanctis, and Dickson [Ref. 3] in their experimental 
investigation, the DGDSS software used in this research will 
enable group members to anonymously generate information, 
store and publicly display criteria and alternatives 
generated, aggregate and publicly display the groups' 
ranking's of criteria and alternatives, enable group members 
to anonymously vote, and correlate the votes leading to the 
final solution. In contrast to the DECAID GDSS software, 
the DGDSS software used in this study also provides a 
message sending/receiving communication component to enable 


group discussion. 


Pr. CAPABILITIES AND LEVELS OF SUPPORT 
GDSS capabilities directly affect the decision makers in 
the group decision making process. This is because: 


- The capabilities provided to the decision maker will 
depend on the GDSS level of support. 


- Certain GDSS capabilities will have an impact on group 
behavioral issues. 


- Capabilities provided will have an effect on GDSS use 
by the decision makers. 


The capabilities provided by a GDSS will most often 
depend upon the level of support the GDSS is expected to 
provide the decision making group. Levels of support are 
defined by DeSanctis and Gallupe as: 

Level 1 GDSSS provide technical features aimed at 
removing common communication barriers, such as large 
screens for instantaneous display of ideas, voting 


solicitation and compilation, anonymous input of ideas and 
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preferences, and electronic message exchange between 
members.... 


Level 2 GDSSs provide decision modeling and group 
decision techniques aimed at reducing uncertainty and 
"noise" that occur in the group's decision process.... 
Modeling tools to support analyses that ordinarily are 
performed in a qualitative fashion, such as social 
judgment formation, risk analysis, or multiattribute 
utility methods can be introduced to the group via a 
Level 2 GDSS.... 

Level 3 GDSSs are characterized by machine-induced 
group communication patterns and can include expert advice 
in the selecting and arranging of rules to be applied 
during a meeting. [Ref. 15:p. 594] 

The decision as to whether the system should be designed as 
a Level 1, Level 2, or Level 3 will be determined by the 
decision makers' tasks (i.e., Planning, Idea Generation, 
Problem Finding) that the GDSS is expected to support. In 
turn, most of the capabilities provided by the GDSS will 
depend on the Level of the GDSS. The editors of EDP 
Analyzer [Ref. ll:p. 7] believe that "word processing and 
data processing capabilities, spreadsheet and graphics 
capabilities, a database management system for handling 
queries, learning and help facilities, and menus that prompt 
for the input of text, data, or votes" should be provided in 
all GDSSs. They go on to list additional capabilities 
including anonymous recording of ideas and the formal 
selection of a leader that could be classified as additional 
GDSS features. 

In the current DGDSS study, many of the capabilities 


proposed by the editors of EDP Analyzer would not be cost 
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effective or necessary, specifically the word processing, 
spreadsheets, graphics, and database management system for 
handling queries {Ref. ll:p. 7]. Furthermore, these 
capabilities were also missing from the GDSS software used 
in the experiment conducted by Gallupe, DeSanctis, and 
Dickson [Ref. 3] with no impact on the final results. This 
lack of impact may be due to the fact that the GDSS software 
used in the experiment was a Level 1, and the capabilities 
provided were dictated by the level of support needed for 
the decision making task. 

While capabilities available in a GDSS can assist a 
decision making group in the completion of their task, 
certain capabilities like anonymity, voting, or 
brainstorming, and their application in any given group 
decision making session can have a positive impact on group 
behavioral issues including deindividuation, pressures 
towards consensus, problems of coordination, and diffusion 
of responsibility [{Refs. 3,4,16,18,19]. 

Deindividuation occurs when an individual group member 
becomes so identified with the group that his/her values, 
morals, and ideas become clouded. The group member gets 
caught up in the momentum of the group's problem. Jelassi 
and Beauclair cites examples of lynch mobs and mass hysteria 
as extremes of this type of behavior. They go on to state 
that GDSS could help in eliminating this unwanted group 


behavior because the group member must type in their input 
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for the decision making session. Using a keyboard, the 
member must first think of the input, then rethink it when 
typing it in. This process helps the group member to 
evaluate his own input prior to submission [Ref. 16]. 

Pressure towards consensus is very similar to 
"groupthink". The group member goes along with the group's 
solution because of his/her identification with the group or 
because of group pressure to agree. Jelassi and Beauclair 
point out that groupthink can lead to less alternatives 
being generated and a very risky group solution. They 
believe a GDSS can alter this situation by providing 
anonymity to group members. The GDSS can be designed to 
allow all phases of group decision making including voting 
to be anonymous. This reduces peer pressure on members 
while enhancing their ability to generate input freely [Ref. 
16). 

Group coordination problems result from a group having 
no identified leader or lacking structure in their decision 
making process. Either of these problems could result in 
the group going off on tangents while trying to find a 
solution to a problem. Jelassi and Beauclair feel that a 
GDSS can alleviate this problem by providing structure in 
group decision making. The GDSS software can be programed 
to mimic the decision making process and to prompt decision 
makers for the necessary input at the different phases in 


the process. With an established structure, the group is 


24 


capable of organizing the decision making process which will 
eliminate the need for a leader and offer a procedure that 
will lead to problem identification and solution. 

Diffusion of responsibility results when some group 
members feel that the decision, good or bad, is the group's 
decision but not theirs. When all members of a group feel 
this way, it may lead the group to choose a less 
responsible, more risky solution. Jelassi and Beauclair 
point out that there are situations where diffusion of 
responsibility can be good in group decision making. An 
example is when a group is faced with a problem where a 
creative solution is needed. A GDSS can assist the positive 
aspects of diffusion of responsibility by allowing for 
anonymous input of individual information. This anonymity 
results in members feeling less conservative in their 
thoughts since no other group member will know who 
contributed what input. If it is discovered that the group 
suffers from the negative impacts of diffusion of 
responsibility, the GDSS can be designed without anonymity 
of individual inputs, thus placing the member's name next to 
his input. Finally, the capabilities provided by the GDSS 
will have a direct impact on the system's use by the 
decision makers. Huber points out that: 

..-1f the system's capabilities are well chosen, the range 
of tasks supported will increase with increases in the 
number of capabilities. Thus, there is an eventual 
synergistic effect on the frequency of GDSS use that 
follows from the inclusion of capabilities that widen the 


range of supported tasks. [{Ref. 9:p. 197] 
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All three of the capabilities, voting, anonymity, and 
brainstorming, presented by Jelassi and Beauclair have been 
incorporated into the present study's DGDSS software. 

The present study will attempt to further GDSS research 
on which DGDSS capabilities are most needed and desired by 
decision makers in a geographically distributed decision 


making environment. 


G. USER EXPECTATIONS OF THE GDSS 

As previously stated, the success or failure of a GDSS 
in any organization will depend on its ability to assist a 
group of decision makers in their problem solving tasks. 
This determination will be made by the decision makers 
themselves. They will base their opinion upon not only what 
the system can do but also on how well the system does it 
and if the system meets their original expectations. 

Since the purpose of a GDSS is to assist in a decision 
making setting, most decision makers would expect the GDSS 
to be easy-to-use. When this expectation 1s not met, 
decision makers find themselves spending more time trying to 
learn how to operate the GDSS instead of investigating 
possible solutions to the problem at hand. This creates 
frustration with the system that invariably leads to less 
usage by the decision makers. 

Another expectation that many decision makers have is 


that the GDSS will speed up the decision making process by 
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retrieving, processing, displaying and calculating 
information faster then it could be done in a traditional 
group decision making session. As Jelassi and Beauclair 
point out, the decision makers' expectations are justified: 
A GDSS should be fast (in terms of response time) for 
the individual as well as the group. By providing quick 
results, the GDSS is better able to facilitate the group 
process. Instant feedback helps reduce confusion on 
issues, boredom, and enhances confidence in the system. 
[Ref. 16:p. 151) 
The decision makers' expectation that the GDSS should be 
fast probably resulted from their previous experiences using 
other computer operated systems. The GDSS should meet this 
expectation. If the GDSS is designed with procedures that 
are efficient in their operations, then the GDSS should be 
reasonably fast. On the other hand, if the GDSS is not 
designed with efficiency in mind, the decision makers may 
find themselves waiting for long periods while the GDSS 
compiles or retrieves data. In a situation such as this, 
the disgruntled decision makers begin to wonder if the GDSS 
is even necessary Since they may have been able to do the 
operations faster manually. 
Having a defined structure of the decision process 
improves the degree of accuracy and the response time of the 
system. Certain software applications such as voting, 


rating, brainstorming, as well as computerized nominal group 


techniques can help groups formulate problems clearly 
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through a predefined structure of the decision process [Ref. 
16:p. 150-1]. 

This structure has proven in many instances (Watson, 
DeSanctis and Poole [{Ref. 20], Steeb and Johnston [Ref. 18], 
Turoff and Hiltz [Ref. 4}]) to be extremely advantageous in 
assisting the decision making process. Although most GDSS's 
are developed to provide structure in group decision making, 
another expectation is flexibility. There is a difference, 
though, between providing structure and providing 
flexibility. Flexibility in a GDSS allows the decision 
makers to error or change their mind without causing 
complete collapse of the system. Other examples of 
flexibility would be to allow recall of previously displayed 
information, switch repeatedly between displays, cancel a 
message prior to transmitting, and make a mistake that 
doesn't result in being dumped from the system. Failure to 
provide flexibility in a GDSS can result in decision makers 
choosing not to use the system because they are unable to 
work within the limitations set forth by the system. 

Finally, some users have unrealistic expectations of 
what a GDSS can do. These expectations range from expecting 
the GDSS to handle every task imaginable to believing the 
GDSS will provide the decision makers with a perfect 
solution. As ridiculous as these expectations may sound, a 
vague explanation of GDSS's and their capabilities offered 


by developers and vendors may unintentionally lead group 
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members to believe that such an advanced system exists. The 
following excerpt taken from an actual study conducted by 
Watson, DeSanctis and Poole, demonstrates that this belief 
in the existence of such advanced GDSS systems should not be 
disregarded as imaginary. "Group members [expect] the 
computer to produce the solution for them. They [focus] on 
using the system very mechanically and [are] sometimes 
dismayed when the system [does] not magically give the 
'right' answer." (Ref. 20:p. 475] 

The developer or vendor of the GDSS should ensure that 
decision makers understand the system's capabilities. This 


Will promote system usage and reduce user frustration. 


fee 6 LASK TYPE/DEGREE OF DIFFICULTY 

Decision makers rarely are faced with making decisions 
On one type of task throughout their entire work-life. Most 
organizations address a multitude of problem types in the 
daily operation of their business. Because of this task 
variety faced by organizations and the decision makers who 
run them, the subject of task type and its characteristics 
must be examined when designing a GDSS. DeSanctis and 
Gallupe [Ref. 15] introduce six task types that decision 
makers may face when working in a group decision making 


session: Planning, Creativity, Intellective, Preference, 
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Cognitive conflict, and Mixed motive. Each of these tasks 
can be broken down into one of three categories--Generat- 
ing, Choosing, and Negotiating--which delineate the purpose 
of the group decision making session. DeSanctis and Gallupe 
briefly define these categories as follows: 

- GENERATING ideas and actions. Planning tasks require 
generation of action-oriented plans. Creativity tasks 
require generation of novel ideas. 

- CHOOSING alternatives. Intellective tasks require 
selection of the correct alternative. Preference tasks 
require selection of an alternative for which there is 
no objective criterion of correctness. 

- NEGOTIATING solutions. Cognitive conflict tasks 
involve resolution of conflicting viewpoints, and 
mixed-motive tasks involve resolution of conflicting 
motives of interest. [Ref. 15:p. 600] 

The importance of considering the tasks confronting the 
group when designing the GDSS cannot be overemphasized. By 
evaluating the tasks, the designer can identify the GDSS 
capabilities needed to assist the decision makers. 

An important characteristic of a task is the level of 
difficulty associated with it. DeSanctis, Gallupe, and 
Dickson [Ref. 3] explain task difficulty as being a relative 
concept that can only be measured by comparing it to other 
tasks. 

Assessment of task difficulty can be made by asking 
decision makers their perceptions of relative difficulty. 
But evidence of difficulty is more objectively implied in 
(1) decision makers' relative performance in tasks (more 
agifficult tasks will be properly completed by a smaller 
proportion of people than less difficult tasks), and (2) 
the amount of time spent in completing the task (more 


difficult tasks will take longer for people to complete 
than less difficult tasks). [Ref. 3:p. 280] 
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Tasks requiring extensive use of mathematics or presenting 
extreme risk to the organization may be viewed as being very 
difficult to some, yet fairly easy to others. It will 
eventually depend on the decision makers as to the perceived 
level of difficulty of any particular task. But the 
possibility of extreme difficulty in a task, implied or 
factual, should be taken into consideration when designing 
the GDSS. 

Another characteristic of the decision maker's task that 
must be considered is its ability to invoke a sense of 
"emotion" in the group. Emotion in group members can best 
be understood by considering how group members will approach 
certain decision making sessions. If the session is called 
to solve an organization's operating problem which is 
important but neither life threatening nor financially 
catastrophic, group members will probably go about the 
decision making session in a calm, resourceful manner. On 
the other hand, if the session is called to find a solution 
to a crisis situation or sensitive problem, the decision 
makers may feel a greater sense of urgency and purpose in 
finding a solution. Designers of the GDSS should note that 
the patience demonstrated by decision makers working on one 
type of problem may not be the same when faced with a more 
emotionally demanding problem. Problems in the operation of 


the GDSS, information processing speed, or GDSS capabilities 


3. 


provided will not be tolerated quietly by decision makers 
trying to work out a crisis. 

There is still another view presented by Suchan, Bui, 
and Dolk in a Contingency Model of the GDSS assisting 
decision makers with tasks. The model correlates tasks to 
relationship bringing about areas where a GDSS may not 
assist the group decision makers well at all. They define 
task and relationship as follows: 


- Task: a problem whose solution requires precise, 
linear thinking: 


- Relationship: a relatively unstructured problem whose 
solution affects the formal and informal values and 
norms of behavior (in the broadest sense) held by 
corporate staff and the organization's employees. 

(Ref. 17:pp. 444-5} 
Using the Contingency model to show relative effectiveness 
of the GDSS, Suchan, Bui, and Dolk demonstrate that in High 
Relationship/Low Task and Low Relationship/Low Task problem 
types faced by decision makers, the decision makers would 
not benefit from the use of a GDSS. With High Relationship/ 
High Task problem types, the decision maker could benefit 
from a GDSS, but the GDSS should be integrated with some 
other form of problem solving. Finally, the Low 
Relationship/High Task problem type is strongly recommended 
for the GDSS environment. Although extensive research to 


support the claim of the contingency model has not been 


done, the concept is worth examing especially since the 
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aspect of relationship in problem solving is not an 
analytical but an emotional factor. Considering that a GDSS 
is designed for rational problem solving through usage of 
data, input, and model applications, there is nothing built 
into the system to support emotional factors that may be 
important in some organizational decision making sessions. 

The current DGDSS study incorporates a crisis planning 
type task with a high degree of difficulty. It would be 
rated as High Relationship/Low Task in the Contingency 
model. By using this task type and degree of difficulty, 
this study should further the research on the potential of a 
DGDSS assisting decision makers handling this type of 


problem solving situation. 


I. INFORMATION SHARING 
Information sharing is the one capability that must be 
taken seriously when designing a GDSS. 

Groups are superior to individuals for decision 
analyses. Groups are usually better at generating options 
and probing their relative advantages and disadvantages; 
therefore, groups have a better chance of structuring an 
1ll-structured situation. However, to be effective a 
group will require a great deal of communication among the 
participants. ([(Ref. 4:p. 82] 

Without the ability to share information, the idea of group 
decision making is reduced to individual decision maker's 


recommending personally contrived solutions based on limited 


information. 
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Since the group decision making process does require the 
members to interrelate with each other to reach a solution, 
the GDSS provides a medium to support group interaction 
called the information sharing capability. The GDSS 
information sharing capability will enable the group to 
display, transmit, and receive information. Additionally, 
as demonstrated by Huber [Refs. 8,9], the information 
supported can be textual, numeric, or relational depending 
upon the design of the information sharing capability. 

In addition to providing group decision makers with a 
medium to share information, the GDSS information sharing 
capability purposely changes the mode of group decision 
making communications. As explained by DeSanctis and 
Gallupe: 

Supporting group decision making primarily involves 
changing, in a positive direction, the interpersonal 
exchange that occurs aS a group proceeds through the 
problem solving process. In this sense the goal of GDSS 
is to alter the communication process within the groups. 
The greater the degree of change in communication 
introduced by the technology, the more dramatic the impact 
on the decision process and, presumably, on the decision 
outcomes. [Ref. 15:p. 591] 

As DeSanctis and Gallupe point out, the GDSS information 
sharing capability is dynamic, with the design differing 
from one GDSS to another. The information sharing 
capability can be limited to receiving and displaying group 
members information on a public screen or it can be expanded 


to include private display, manipulation of information, and 


other features. Because there is no one specific 
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information sharing design that is suitable for all GDSS's, 
it is imperative that the designers of the GDSS investigate 
how the system is expected to enhance the group decision 
making process. 

In their presentation of different behavioral issues 
that can affect the group decision making process, Jelassi 
and Beauclair explain how the GDSS's communication and 
information sharing capability can be designed to enhance 
group decision making. 

The system should provide communication and 
information sharing as much as possible and when 
desirable. This should be accomplished through local as 
well as public display, and allow for brainstorming in 
addition to data and model sharing. This feature would 
allow participants to generate ideas freely and without 
prejudice, and have a shared model that can serve as a 
basis for discussion. [(Ref. 16:pp. 151-2] 

The ability of the GDSS to support information sharing among 
group decision makers is extremely important. This 
importance is magnified when the information sharing 
capability being designed is part of a DGDSS. 

When the group decision makers are geographically 
distributed, they are unable to both see and verbally 
communicate with each other. Their only means of 
communication and information exchange is provided by the 
DGDSS. Since they are jointly working on a problem, it is 
of the utmost importance that they know the group's progress 


towards finding a solution and be able to communicate with 


other members on that progress. The DGDSS assists by 
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receiving and displaying on each decision maker's computer 
terminal all information about the problem as the problem is 
worked on. Additionally, since it is natural for decision 
makers to discuss information, the DGDSS has a communication 
component that enables decision makers to send and receive 
messages. 

Although the DGDSS illustrated presents a very limited 
information sharing and communication capability, it 
demonstrates that without these capabilities the DGDSS 
cannot assist group members in the distributed decision 
making process. The information sharing capability and 
communications component are the two most vital parts of the 
DGDSS. Furthermore, it should be evident that even if the 
group members are not geographically distributed, and they 
are using a GDSS instead of a DGDSS, without an information 
sharing capability, the system cannot assist the group in 


the decision making process. 


J. DGDSS COMMUNICATIONS 

For a DGDSS to provide the kind of support needed to 
adequately assist the group decision makers in a real-time 
distributed decision making meeting, the communication 
component would have to be enhanced beyond the capabilities 
offered in a regular GDSS. Bui and Jarke (Ref. 2] identify 


and explain three roles, Coordinator, Detective, and 
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Inventor which they view the communication's component of 
the DGDSS as having to play throughout a decision session. 

The coordinator ensures that a specific communications 
protocol is kept throughout the decision session. This 
protocol will ensure that there is equal opportunity for 
participation and no one individual can manipulate the 
communications process. The Detective ensures that personal 
data, information, or voting remains anonymous. The 
Inventor takes note of incorrect formats in exchanging 
information and suggest other possible formats. 

Bui and Jarke [Ref. 2] propose an architecture which 
would link the communications component with the individual 
computer terminals throughout the DGDSS with the use of a 
computer network: 

The communications component could be built by 
implementing a Group Norm Constructor, a Group Norm 
Filter, an Invocation Mechanism, and a circumstance-shaped 
IDSS-to-GDSS Formatter in the application and presentation 
layers of the ISO model. [{Ref. 2:p. 18] 

Although an actual application of this architecture has yet 


to take place, the concept proposed does have possibilities 


as a future method of DGDSS communications. 


K. DGDSS 

Although DGDSS and GDSS design may differ slightly, a 
proper design that provides the needed capabilities-- 
especially information sharing--is for equally important for 


both. However, the DGDSS communication component will hold 


oy, 


greater importance than it would in a regular GDSS. The 
ability for decision makers to communicate quickly and 
without difficulty is imperative for a DGDSS to be 
effective. 

Finally, the DGDSS must have the confidence of the group 
decision makers. Although this is true of any GDSS, it is 
especially relevant in the case of the DGDSS. When 
individuals are remotely located and their DGDSS computer 
terminal begins to malfunction due either to technical error 
or operator error, the frustration felt by the decision 
maker would be magnified dramatically compared to a similar 
problem in a Decision Room setting. 

There is a future for the DGDSS, but more research on 
development and design as well as actual experiments of a 
system will be needed before the extent of its potential is 


known. 


line PREVIOUS EMPIRICAL STUDIES 
The current study hopes to further GDSS research by 
evaluating and testing an experimental prototype DGDSS 
software program. Through this investigation, the following 
research questions will attempt to be answered: 
- Which DGDSS user capabilities are most desirable? 
- Which DGDSS user capabilities are most needed? 


- Does the design of the DGDSS enhance or disrupt the 
decision process? 
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- Does the DGDSS have the potential to provide better 
decision quality and increased decision maker 
participation? 


- Can the DGDSS be improved to provide better assistance 
to decision makers in a distributed setting? 


Although no previous empirical studies exist on the 
DGDSS, studies by Gallupe, DeSanctis and Dickson [Ref. 3], 
Turoff and Hiltz [Ref. 4], Steeb and Johnston [Ref. 18], 
Nunamaker, Applegate and Konsynski [Ref. 19], and Watson, 
DeSanctis and Poole have been conducted on the GDSS [Ref. 
20]. Through these previous studies, knowledge has been 
obtained on various effects that a GDSS has on the group 
decision process. Since the DGDSS is a subsystem of the 
GDSS, previous research results in the areas of interest 
that relate to the questions posed in the current study will 
be discussed. However, because each previous research study 
1s unique in its composition, a brief summation of each 
study and its results that relate to the current study will 
be presented first. 

1. Gallupe, DeSanctis, and Dickson 

Gallupe, DeSanctis, and Dickson's [Ref. 3] study 
used a problem finding task type. They investigated the 
effects that the level of task difficulty would have on 
different aspects of the group decision process, including 
decision quality, number of alternatives generated, and 
satisfaction with decision process. The results of their 


study demonstrated that use of the GDSS both improved 


og 


decision quality and increased the number of alternatives 
generated by decision makers, regardless of the degree of 
task difficulty. Additionally, they found that the degree 
of task difficulty between the GDSS groups did not affect 
the decision makers' satisfaction with the decision process. 
However, the GDSS groups were significantly less satisfied 
with the decision process then the non-GDSS groups. 
2. Watson, DeSanctis, and Poole 

Watson, DeSanctis, and Poole's [{Ref. 20) study 
compared the effects of group consensus among three groups: 
those assisted by a GDSS, those assisted with paper and 
pencil but no GDSS, those with neither a GDSS or paper and 
pencil. The task type used was a preference allocation 
problem. Among the various results of their study, it was 
demonstrated that GDSS groups had generated more input into 
the group's solution then either of the non-GDSS groups. 
Additionally, they found that the structure provided by the 
GDSS assisted in managing group conflict which improved the 
degree of post meeting consensus. 

Sq) SLUPROTE cand] Haske 

The Turoff and Hiltz (Ref. 4] study incorporated a 
computerized conferencing system to serve as a GDSS. Their 
experiment was two-fold. First they compared groups using 
the system for an unstructured decision process with groups 
meeting in a traditional face-to-face decision session. 


They then did a second experiment using the same format for 
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the non-computerized group; but, in the computerized group, 
they assigned a group leader and incorporated statistical 
capabilities into the system that would display group 
progress. The problem used was an intellective task type 
with a moderate to high degree of difficulty. Their 
experiment focused on decision quality and consensus on 
final solution. The results of the first experiment 
demonstrated that the quality of decision did not differ 
between the two groups regardless of the computerized 
conferencing system. However, decision quality for the 
computerized groups did improve in the second experiment. 
4. Nunamaker, Applegate, and Konsynski 

Nunamaker, Applegate, and Konsynski's [{Ref. 19] 
study investigated the influence of automated technology on 
the idea generation and analysis phases of decision making 
when using a planning task type. Their experiment was 
conducted on participants uSing electronic brainstorming 
software. The results of the study indicated a high degree 
of satisfaction among the participants with the electronic 
brainstorming system for idea generation. Additionally, 
participants demonstrated a high degree of satisfaction with 
the outcome of the session as well as the process used to 
achieve the goals of the session. 

5. Steeb and Johnston 
Steeb and Johnston's [Ref. 18] study incorporated a 


crisis planning task type with a high degree of difficulty. 
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They found that groups using the GDSS were more satisfied 
with the number of alternatives generated and the 
opportunity to look back at the group's progress, but group 
members were more resistant to decision making procedures. 
Furthermore, some members in groups with no GDSS support 
felt that viable alternatives were dropped due to group 
pressure, and more structure in the deliberation phase of 
the decision process was needed. 


6. Correlation Between Previous Research and Current 
Sie wey 


The current study is similar to the Steeb and 
Johnston study in that a crisis planning task type problem 
with a high degree of difficulty is used. Unlike Steeb and 
Johnston, though, the level of support provided by the DGDSS 
is only a level 1, whereas theirs was a level 2. The reason 
behind the difference is that although many facets of the 
problem faced are very Similar--including that of a 
terrorist situation--level 2 capabilities were not provided 
in the experimental DGDSS prototype. The lack of this 
capability is not expected to affect the outcome of the 
study because it is believed that crisis planning can be 
done adequately without level 2 support. 

Similar to Gallupe, DeSanctis, and Dickson [(Ref. 3], 
and Turoff and Hiltz [Ref. 4], the current study is 
interested in decision quality. Although the Gallupe, 


DeSanctis, and Dickson study results showed the degree of 
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Bask Gdatticulty had no significance on decision quality, it 
did demonstrate that use of a GDSS resulted in greater 
decision quality. Since the only differences between the 
current study and the one by Gallupe, DeSanctis, and 
Dickson, are the task type and configuration of the GDSS, it 
is expected that any difference between the results of the 
two studies would be due to these two variables. However, 
as mentioned previously, the Steeb and Johnston study also 
used the same task type with no noted decrease in decision 
quality. Therefore, if decision quality is found to be 
negatively affected in the current study, it may be due to 
the DGDSS itself or the decision setting. Furthermore, 
Turoff and Hiltz stated that decision quality improved with 
the incorporation of a defined leader and "computer 
feedback" capabilities. The current study provides 
structure to the decision session as well as information 
sharing capabilities to display information generated 
through the experimental prototype DGDSS software. If the 
current study's results demonstrate poor decision quality 
and evidence that the DGDSS is disrupting the decision 
making process, then the design structure and capabilities 
may be the cause of these results. 

The current study will also measure whether there is 
an increase in decision maker participation. Studies by 
Gallupe, DeSanctis and Dickson, Steeb and Johnston, 


Nunamaker, Applegate and Konsynski, and Watson, DeSanctis 
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and Poole demonstrated high satisfaction among decision 
makers on the number of alternatives generated [Refs. 3,18, 
19,20). Since alternatives generated directly relates to 
decision maker participation, the high group member 
satisfaction level resulting from the number of alternatives 
generated was due to greater participation by decision 
makers. If this inference is true, then the present study 
should have results demonstrating increased DGDSS decision 
maker participation. 

Finally, previous research on satisfaction with the 
decision process differs among studies. Gallupe, DeSanctis, 
and Dickson [{Ref. 3] reported that decision makers were less 
satisfied, while Nunamaker, Applegate, and Konsynski [Ref. 
19}, and Steeb and Johnston (Ref. 18] found decision makers 
to be highly satisfied. What caused these differences is 
unknown. It has been speculated that it may be due to the 
difference between the levels of GDSS support. However, it 
is unlikely that the level of support played a great role 
since only Steeb and Johnston used a level 2 GDSS and the 
other two studies used level 1 GDSS's. As previously 
mentioned, the current study also uses a level 1 GDSS and 
will attempt to find out if the DGDSS enhances or disrupts 
the decision process. This study's final results on DGDSS's 
effects on users' satisfaction with the decision process 
will clarify reasons for these contradictory research 


results. 
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Although previous GDSS empirical studies are 
limited, they have resulted in furthering the research in 
the field of group decision support systems. Additionally, 
they have laid the ground-work for further GDSS studies to 
be conducted that will result in concurrence or divergence 
with the results of the previous studies, or possibly even 
an investigation into a different area of GDSS research that 
has yet to be encountered. It is this different area of 
GDSS research, the DGDSS, that the current study will 


investigate in an attempt to further GDSS research. 


M. SUMMARY 

A brief explanation of DSS and its similarities and 
differences to GDSS opened this chapter. This was 
immediately followed by an in-depth look at major aspects of 
the GDSS including: Categories of GDSS, Design Frameworks 
and Strategies, System Capabilities and Levels of Support, 
Task Types and Degrees of Difficulty, and Information 
Sharing, and the relevance of each respective aspect to 
DGDSS and the current study. Also included was a discussion 
on the importance of the communications component in the 
DGDSS. Since the central focus of the current study is the 
DGDSS, a brief explanation of the importance of proper 
design and user confidence was presented. This literature 
survey was concluded with a discussion on previous GDSS 


empirical studies that demonstrated results to research 
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questions on the GDSS which are similar to the questions 
purposed in the current DGDSS study. By using the knowledge 
offered by the previous studies as a guide, it is expected 
that the results of this study will extend GDSS research in 


the area of DGDSS. 
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(ie RES aRCH METHOD 


ee SUBJECTS 

This study was based on an experiment involving six 
four-person and four three-person groups. Three and 
four-person groups were used, as has been done in previous 
similar studies, (Turoff and Hiltz, 1982 [Ref. 4]; Steeb and 
Johnston, 1981 [Ref. 18]; Watson,DeSanctis and Poole [Ref. 
20). Of the 36 subjects, four were female. Subjects were 
selected from officer-student volunteers of the Computer 
Systems Management curriculum at the Naval Postgraduate 
School (NPS), Monterey, CA. 

Graduate students are attractive subjects for 
experiments such as this because of their similar age, 
experience and background. NPS students of the CSM 
curriculum offered additional qualities in that they share 
relatively common military backgrounds, have established 
working relationships as small groups, and a higher level of 
experience with computer equipment than students of other 
curriculums. Subjects were either in the process or had 
completed one course in Decision Support Systems and 
therefore were familiar with DGDSS terminology. 

1. Group Composition 

Of the 36 subjects who participated in the study, 


22 subjects participated in the DGDSS experiment--four 
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four-person groups and two three-person groups. Fourteen 
subjects participated in the traditional decision 
sessions--two four-person groups and two three-person 


groups. 


B. THE DGDSS 

The DGDSS software used in this experiment was adapted 
from a prototype version of a GDSS currently under 
development at Claremont University in Los Angeles, CA. The 
version used in this study was modified for use in 
distributed settings (DGDSS). The software was designed to 
generate criteria and alternatives and to help generate 
consensus through anonymous ranking of alternatives. 

The system provides a means for recording and displaying 
problem, criteria, and alternative descriptions. It also 
allows the decision makers to add their own comments to 
criteria and alternatives. Since the system is distributed, 
a browsing feature is included for decision makers to review 
each others' inputs. Once the ranking, weighing and scoring 
of criteria and alternatives are entered, the results can be 
displayed. An electronic mail facility is included for 
sending short messages between decision makers. 

The DGDSS provides a systematic, structured process for 
decision making in that each decision maker reviews the 
problem description, enters and ranks criteria, enters and 


ranks alternatives, assigns relative weights to criteria, 
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scores alternatives against criteria, and displays the 
results. 

The system uses a menu driven format where each menu 
contains a set of cards. Each card equates to a module 
which controls a phase--criteria, alternatives, scoring--in 
the structured decision process. Cards are easily selected 
by using the arrows on the terminal keyboard and when 
selected lead to submenus with additional sets of cards. 


Figure 3.1 shows the main module menu for the systen. 


C. PHYSICAL SETTING 
1. DGDSS 

The DGDSS software was installed on an IBM PC Local 
Area Network (IBM PC LAN, version 1.10) laboratory at NPS 
that was designed for research such as this study. Five 
terminals were designated for the DGDSS, four used by the 
decision group and one for the facilitator. One terminal 
was left out of the system when testing groups of three. 
Each terminal consisted of an IBM PC (AT) compatible with 
color monitor, keyboard, dual floppy disk drives, and hard 
disk drive. The DGDSS terminals were isolated from each 
other by using portable room partitioning devices to 
create individual booths, thus giving the effect of a 
distributed environment. The rear of each booth was left 


open to allow facilitators to observe and assist subjects 
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(see Figure 3.2). DGDSS subjects were provided with a 
user's manual for operating the DGDSS program. 
2. Traditional 

The traditional setting was a conference room with a 
large conference table. The conference room was reserved in 
advance to ensure no interruptions. Subjects were provided 
writing utensils, paper, and a form to record the group's 
criteria, alternatives and final solution. 

3. Facilitators 

Previous research describes the function of 
facilitator as the operator of the technology that supports 
the group activity. The facilitator is responsible for 
conducting the group meeting and directing the participants 
through the group process technique [Ref. 2l:p. 356-7]. 
With respect to DGDSS Kraemer and King describe the role of 
facilitator as: 

The facilitator's role usually evolves to that of a 
trainer and troubleshooter, teaching the participants how 
to use both the hardware/software and the group 
process...and then remaining available for help as 
problems arise.... [Ref. 21:p. 356-7] 

Facilitators were provided in this study for 
traditional and DGDSS sessions. Facilitators' functions 
were to schedule sessions, reserve decision rooms and 
provide writing materials. DGDSS facilitators installed 
software, provided instruction on use of software, gave 


advice to decision makers about the decision process, 


controlled the decision process, manipulated data, performed 
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calculations, controlled displays, and gave technical 
assistance. In addition, DGDSS facilitators were 
responsible for: (1) ensuring that communication remained 
characteristic of a distributed environment; (2) resolving 
problems that might impede or jeopardize the experiment; (3) 
and observing, monitoring and recording data relevant to the 


experiment. 


D. SOFTWARE 

DGDSS software consisted of two programs, one for 
decision makers and the other for the facilitator. The 
decision makers' program was made up of four main modules: 
problem, criteria, alternatives, and scores. 

Each module provided services for a different phase of 
the decision process. The problem module allowed the 
decision maker to log-onto the decision session. The 
criteria and alternatives modules provided a means for 
entering the descriptions, ranking, and displaying results. 
The scores module was used to assign relative weights to 
criteria, score alternatives against criteria, and display 
the final solution. The facilitator program allowed the 
facilitator to enter the problem description and control the 
decision process. The facilitator could also combine 
redundant criteria and alternatives and impose cut-off 
values for ranking. Cut-off values were used to 


discriminate against low ranking criteria and alternatives. 
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By eliminating those that fell below the cut-off value, only 
higher ranking, more desirable criteria and alternatives are 
retained for subsequent re-ranking. In addition, the 
software provided a message sending facility for the 
facilitator and decision makers. 

1. Theory of Operation 

The DGDSS software useS a variation of Saaty's 

"Analytic Hierarchy Process" (AHP) to generate consensus. 
AHP is a framework for decision making that adds structure 
to unstructured problems by dividing the problem into its 
different components. The process organizes feelings and 
intuition and logic in a structured approach to decision 
making and aids group decision making by adding discipline 
to the group thought process [Ref. 22:p. 3226) - 7) ime 
following 1s a brief summary of AHP: 

The analytic hierarchy process enables decision makers 
to represent the simultaneous interaction of many factors 
in complex, unstructured situations. It helps them to 
identify and set priorities on the basis of their 
objectives and their knowledge and experience of each 
problem. [Ref .. 22... izes) 

Each set of elements in a functional hierarchy 
occupies a level of the hierarchy. The top level, called 
the focus, consists of only one element: the overall 
objective. Subsequent levels may each have several 
elements....[{T]he elements in one level are...compared 
with one another against a criterion in the next higher 
level.... [Ref. 22:p. 28] 

The DGDSS software in this study used a hierarchy of 


three levels: final solution, criteria, and alternatives. 


The criteria and alternative levels had multiple elements. 
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Criteria were given a priority by assigning each a relative 
weight. Alternatives were then compared--scored--with each 
other against each criterion to arrive at a final solution. 


(See Figure 3.3) 


Ee SESSION 

DGDSS and traditional sessions were scheduled for 
two-hour periods. Sessions were allowed to continue past 
two hours if necessary. Sessions were divided into three 
parts: a brief description of the session, the actual 
decision problem session, and a questionnaire evaluation. 
Additionally, the DGDSS session included a 30 minute 
training session. At least one day prior to each session, 
subjects were given a one page pre-scenario. The 
pre-scenario provided pertinent background information about 
the decision problem but did not divulge the specifics about 
it. A copy of the pre-scenario is included in Appendix B. 

1. DGDSS 

Subjects were provided with an abbreviated users 

manual to use as a memory-aid during the session; however, 
the guided session was usually sufficient to preclude the 
need for the user's manual. Facilitators described the 
definitions of criteria and alternatives and gave an 
explanation of ranking, weighing and scoring. Subjects were 


allowed to communicate freely during the practice session. 
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Following the practice session and short break, 
subjects were presented with the decision problem scenario. 
Upon receiving the scenario, subjects were not allowed to 
ask questions relating to the scenario but could request 
assistance concerning technical matters such as program 
operation. Subjects were asked not to discuss the scenarios 
or session with other subjects during the session. Subjects 
were allowed to communicate only by using the DGDSS progran, 
which allowed each to enter inputs into the system and to 
review the inputs of other decision makers by using the 
message sending facility. The facilitator ensured that 
sessions adhered to the following agenda: 

- Criteria generation. 

- Criteria ranking and review. 

- Alternative generation. 

- Alternative ranking and review. 

- Criteria weighing. 

- Alternative scoring. 

a. Criteria Generation 
At the beginning of the decision session the 

facilitator started and set-up the DGDSS program in the 
criteria phase of the decision process. The decision makers 
could only access the criteria module of their program at 
their terminals. When ready, subjects began entering 
criteria and their descriptions into the system. When 


subjects were satisfied with criteria entered, or wanted to 
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see criteria entered by others, they could browse the 
criteria. This allowed them to view all criteria entered at ) 
the time. Subjects could add their own comments to criteria 
entered by others, which could then be reviewed by the 
group. If redundant or duplicate criteria were entered, the 
facilitator would combine the criteria upon request from the 
decision group. Subjects would inform each other when they 
completed their criteria entries and were ready to rank 
them. 
b. Criteria Ranking and Review 

The anonymous ranking of criteria used a five 
point scale to express their desirability--five being most 
desirable and one being least desirable. Criteria ranking 
addressed the desirability of each criterion individually, 
based on its own merit alone. That is, ranking was not 
intended to compare a criterion with any other criterion. 
This provided a way to eliminate undesirable criteria from 
Subsequent phases of the decision process by retaining the 
most desirable criteria. The subjects signaled the 
facilitator when rankings had been released (sent) to the 
facilitator. When all subjects had signaled, the 
facilitator calculated the results of the ranking and sent 
results back to decision terminals for display and review by 
the subjects. The subjects could choose to accept--unani- 
mous consent from the decision group--or reject the ranking. 


If the ranking was accepted, the facilitator set the program 


ao 


to the alternatives phase and signalled the subjects to 
begin the next phase of the decision process. If rejected, 
the ranking was repeated until accepted. 
c. Alternatives Generation 

When the facilitator had set up the program in 
the alternatives phase, subjects were confined to the 
alternatives module of their program. Subjects began 
entering, browsing, and adding comments in the same manner 
as they had done with criteria. Redundant and duplicate 
alternatives were combined by the facilitator upon request 
from the decision group. The subjects informed each other 
when they completed their alternatives entries and were 
ready to rank. 

dad. Alternatives Ranking and Review 

Anonymous ranking of alternatives also used a 
five point scale to express desirability of alternatives-- 
five being most desirable and one being least desirable. As 
with criteria, alternative ranking addressed the desirabili- 
ty of alternatives individually, based on merit alone and 
not compared to other alternatives. The subjects signaled 
when rankings had been released (sent) to the facilitator. 
The facilitator calculated the results of ranking and sent 
results to decision terminals for display and review. 
Subjects could choose to accept or reject the ranking in the 


same way they had done for criteria. If the ranking was 
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accepted, the facilitator signaled to begin the next phase 
of the decision process. 
e. Criteria Weighing/Alternative Scoring 

When the facilitator set the program in the 
scoring phase, subjects were confined to the scoring phase. 
The scoring phase was made up of two procedures, weighing of 
criteria and scoring of alternatives against criteria. 

Where criteria ranking considers each criterion 
alone, criteria weighing compares criterion with other 
criteria. Weighing used a five point scale which expressed 
the relative importance of one criterion in relation to 
others--five being high and one being low. For example, two 
criteria might be given weights of two and one. This says 
that the criterion given a weight of two is twice as 
important as that which was given a weight of one. When the 
subjects entered weights for each criterion, they continued 
with the next procedure, alternative scoring. 

Alternatives were given a score between one and 
100. Scores provided a means of expressing how well 
subjects felt each alternative addressed or satisfied each 
criterion--one being worst, 100 being best. Each 
alternative was scored against all criteria. This meant 
that if five criterion were entered, each alternative would 
receive five scores--one for each criterion. In addition, 


if five alternatives were entered, there would be a total of 
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25 scores entered--five alternatives each receiving five 
scores. 

Subjects signaled the facilitator when the 
scores had been released (sent) to the facilitator. The 
facilitator calculated the final score and sent results to 
the decision terminals for display and review by the 
decision makers. Results of scoring was presented in the 
form of a bar-graph with alternatives arranged in the order 
of their final score. The highest scoring alternative was 
the groups' solution to the problem. The group could choose 
to accept--unanimous consent by the group--or reject the 
solution. If rejected, the scoring phase was repeated until 
a solution was accepted. If accepted, the solution was 
recorded as the final solution and the decision session was 
concluded. The subjects were then presented with 
questionnaires for evaluating the DGDSS session. 

2. Traditional 

Subjects met in the conference room with the 

facilitator. The facilitator defined criteria and 
alternatives for the subjects. Subjects were provided with 
writing utensils, paper, and a form to record criteria, 
alternatives and its final solution. When subjects were 
ready to begin, the facilitator presented the problem 
scenario. Subjects were allowed to communicate freely 
throughout the session and informed they could use any 


method they found convenient to solve the problem. A 
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facilitator remained present during the session to collect 
data and observe the decision process but did not interfere 
in any way with the session. When subjects had reached a 
final solution, the facilitator collected the list-- 
criteria, alternatives and final solution--and presented 
subjects with the questionnaire. Upon completion of the 


questionnaire, the session was concluded. 


F. QUESTIONNAIRE 
Questionnaires were adapted from those used in similar 
research done by Hughes and Webb, and Watson [Refs. 23,24]. 
DGDSS questionnaires contained 35 questions of which 31 
solicited responses on seven-point scales and four requested 
short comments. Traditional group questionnaires contained 
27 questions, 26 seven-point and one short comment. In 
addition, both DGDSS and traditional questionnaires included 
eight questions about the subjects' personal and background 
information. Copies of each questionnaire are included in 
Appendix A. 
1. DGDSS 
The DGDSS questionnaire was designed to gain 
information about the following: 
- Case problem validity. 
- Suitability of the case problem for DGDSS. 
- Decision satisfaction. 
- Decision confidence. 
- Satisfaction with decision process. 
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Participation perception. 
Communication satisfaction. 

Subjects commitment to the experiment. 
Competence of the experiment. 


Satisfaction with DGDSS software. 


2 Traditional 


The Traditional questionnaire was designed to gain 


information about the following: 


ec. 


Case problem validity. 


Suitability of the case problem for a traditional 
setting. 


Decision satisfaction. 

Decision confidence. 

Satisfaction with decision process. 
Participation perception. 

Subjects commitment to the experiment. 


Competence of the experiment. 


DECISION TASK 


The case problem in this study was chosen because it 


presented the subjects with an unstructured problem of 


relatively high complexity for which no single right answer 


existed. The intention was that a solution to the problem 


would not be intuitively obvious to the decision maker. 


The case problem was a two-part scenario beginning with 


a pre-scenario containing current media depictions of recent 


terrorist activities directed at the United States. The 
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second part was a scenario describing a terrorist attack on 
the Naval Postgraduate School and giving instructions to NPS 
decision makers to take part in a group decision session to 
develop a solution to the problem. A copy of the scenario 
is contained in Appendix B. 
1. Expert's Solution 

Since the scenario described a situation that 
involved property, personnel and policy of NPS, several 
staff members at NPS were given the case problem and treated 
as expert subjects for a final solution to the problem. 
Their method of prescribing a solution included previously 
established guidelines and policy for handling terrorist 
threat situations at NPS. The experts' solution was 
generated without the aid of the DGDSS system. A 
description of the experts' solution--assumptions and 


actions--are contained in Appendix C. 


HH. SUMMARY 

This chapter gave a description of the physical design 
and session procedures for the DGDSS and traditional 
settings. The DGDSS program software operating concepts and 
theory of operation were discussed. Finally, a discussion 
of the decision problem and questionnaire evaluation 
concluded the chapter. In the following chapter we will 
show the results of the experiment, and discuss the analysis 


Of Gur findings 
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IV. RESULTS 


TE INTRODUCTION 

DGDSS test results were obtained from observations and 
data that were recorded during each group's decision making 
session and from the participant's responses to a post- 
session questionnaire. Since observations were made and 
recorded during the actual decision sessions and 
questionnaire responses were taken after the session, the 


results of each will be discussed separately. 


B. OBSERVATION AND DATA 

Throughout both the DGDSS and traditional sessions, the 
facilitator recorded observations of the group's progress in 
the decision process. The DGDSS group facilitator recorded 
notes on notebook paper while the traditional group 
facilitator used an observation form created prior to the 
session. A copy of the observation is included in Appendix 
‘Bie 

Since the traditional group facilitator had a very 
passive role in the decision session, the observation form 
enabled the facilitator to record time and individual group 
member's behavior, which included their participation (body 
attitude, facial expression, communication) in group 


discussion as well as the number of criteria and 
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alternatives they generated. A copy of the traditional 
session observation form is included in Appendix D. 

The method of obtaining data from traditional and DGDSS 
decision sessions differed in that traditional groups were 
given a group solution form for recording the group's 
criteria, alternatives, and final solution. Data from DGDSS 
groups was obtained by recalling data files--created by the 
DGDSS program--after the session was completed. 

Results of the observation and data collected will be 
discussed in three parts: Decision making process, Decision 
Time, and Criteria and Alternative Generation. 

1. Decision Making Process 

Of the six DGDSS and four traditional groups tested, 
only three of the DGDSS groups and all of the traditional 
groups arrived at a final decision. The failure of three 
DGDSS groups to reach a final solution was due to both time 
constraints and DGDSS software failure. Two of these three 
groups went beyond the two hours allocated for the session. 
Group members had prior commitments which prohibited them 
from continuing on to a final solution. The third group 
experienced DGDSS software failure immediately after 
submitting their scoring of alternatives to criteria 
results. While only one DGDSS group arrived at the experts' 


solution, none of the traditional groups did. 
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ar DGDSS 

Observing the DGDSS decision making process was 
tedious. Software failure caused from program inflexibility 
when decision makers erred in their keystrokes became a 
regular occurrence in all DGDSS session. Additionally, as 
the decision makers progressed further in the decision 
session, the DGDSS program performance progressively slowed 
down. Although an exact measurement of this degradation in 
program performance time was not obtained, frustration was 
visually observed in decision makers, especially during the 
alternatives scoring phase. 

Observations of subjects using electronic 
message sending revealed that when participants wished to 
send a message to all group members simultaneously, it was 
necessary to send the message to the facilitator, in an 
abbreviated form, for re-broadcasting. This was necessary 
because the user's DGDSS broadcasting capability failed to 
work. It was also observed that most the message traffic 
sent during sessions pertained strictly to the decision 
problem or decision process. 

be traditional 

In each group, one individual usually assumed 
the role of recorder for the group and another individual 
normally assumed the role of group leader. Although the 


group leader role was never formally determined in any of 
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the groups, each decision session had at least one 
individual who led the group through the decision process. 

The most commonly observed body attitude, facial 
expression, and communication in each of the traditional 
decision sessions was "participating" (sitting up at the 
table speaking, or listening intently and preparing to be 
speak), "relaxed" (content, fulfilled, or in good spirit, 
calm), and "positive verbal" (participating in problem 
discussion, working with the group) respectively. Two 
groups were observed to break periodically from the problem 
discussion to joke around as a group. 

Most groups appeared to use a step-by-step 
decision process establishing criteria first, then 
alternatives, and then re-establishing criteria and 
alternatives until a "specific set" (criteria and 
alternatives deemed by the group as most relevant to the 
problem) was determined by the group. Groups usually chose 
their final problem solution immediately after this set was 
established, which might lead us to assume that group 
members had decided on a solution before all criteria and 
alternatives were evaluated completely. 

2. Decision Time 
Both the DGDSS and traditional group sessions were 
timed from when the case study was presented to when the 
group either arrived at a solution or chose to end the 


session. All times recorded for both DGDSS and traditional 
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sessions were summed and divided by the number of sessions 
respectively to arrive at an average solution time for DGDSS 
and traditional decision session. The DGDSS groups averaged 
105.7 minutes to reach a solution. This was twice the time 
required by the traditional groups, which averaged 52 
minutes to reach a solution. 

Although the exact reason for the significant 
difference in solution time between the two sessions is 
unknown, the following factors may have contributed: slow 
DGDSS program performance, inability of DGDSS members to 
broadcast messages, cumbersome structure provided by the 
DGDSS in the decision making process, anonymous--uninhibited 
input--provided by the DGDSS, participant's level of 
knowledge of the decision process for their respective 


settings, and traditional groups capability for verbal 


discussion. 
3. Criteria and Alternative Generation 
a. DGDSS 


The criteria and alternatives generated during 
DGDSS sessions were saved in data files for later analysis. 
The criteria and alternatives were summed and then divided 
by the number of sessions to determine the average number of 
criteria and alternatives per session. DGDSS sessions 
averaged 9.75 criteria and 12.2 alternatives generated per 


DGDSS session. 
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b. Traditwvonall 

As mentioned earlier, the group's criteria, 
alternatives, and final solution were recorded on the 
solution form by one group member. The method used to find 
the average number of criteria and alternatives generated 
per group was the same as the one used above for the DGDSS 
observation. The results of the traditional group solution 
form showed that the average number of criteria and 
alternatives generated per group was 7.5 and 5 respectively. 

To try to explain the difference in DGDSS and 
traditional criteria and alternative generation, the 
following theory is suggested: It is possible that a larger 
number of criteria and alternatives would have been 
generated by each traditional group but that the group used 
a "weeding-out" process in order to focus on what the group 
believed to be the most relevant. 

It is evident that each of the DGDSS groups 
generated large numbers of criteria and alternatives. This 
1s consistent with Gallupe's finding that "use of the system 
tended to enhance idea generation and heighten the groups 
awareness of multiple viewpoints." (Ref. 3:p. 291} 
Considering the large amount of alternatives and criteria, 
and the fact that anonymity and structured decision process 
encourages input generation, the DGDSS can potentially 
increase decision maker's participation, when compared to 


traditional settings. 
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C. RESPONSES TO THE QUESTIONNAIRE 

Questionnaire responses were tabulated and normalized so 
that all responses reflected uniformly a seven-point Likert 
scale. The scale extremes, 1 and 7, represented extreme 
negative and extreme positive responses respectively. 
Furthermore, the scale used the midpoint, 4, as a neutral 
point on all questions. Comparisons between DGDSS and 
traditional settings were done using one-tail "t" tests, at 
p < 0.05 to test for significant differences in sample 
means. 

Results of the questionnaire have been compiled and will 
be presented in the following areas: Case Validity, Case 
Suitability for DGDSS/Traditional Settings, Decision 
Satisfaction, Confidence and Commitment, Satisfaction with 
Decision Process, Participation, Communication Satisfaction, 
Competence of the Experiment, and Satisfaction with the 
DGDSS Software. 

1. Case Validity 

Case validity measured the ability of the case to 
present a problem to decision makers that was challenging 
but solvable. Care was taken to ensure that our case study 
had adequate task difficulty and realism (case validity). 
Lack of case validity was found to be an experimental design 
problem in Hughes and Webb's previous research [Ref. 23]. 
Case validity was determined by measuring three variables, 


case complexity, case realism, and how well the case 


Gat 


resembled an actual situation. Since both DGDSS and 
traditional settings evaluated the same case problem, an 


aggregate statistical description was used (Table 4.1). 


TABLE 4.1 


MEAN AND STANDARD DEVIATION FOR 
CASE COMPLEXITY AND REALISM 





Case Validity Mean SD 
Complexity 4.917 ilps aise 
Realism 4.583 12528 
Actual Situation Beal? 1.6025 


Subjects were asked to express their level of 
agreement with the following statements: 


- Immediately after reading the case study, the correct 
solution was not intuitively obvious to me. 


- This case study seems realistic to me. 


- This case study could be an example of an actual 
decision making situation. 


Case validity was determined to be more than 
sufficient for this experiment. Point values were summed 
and divided by the number of subjects to arrive at an 
aggregate score (mean) for each statement. Scores in Table 
4.1 show that subjects slightly agreed (mean = 4.917) the 
solution was not obvious and generally tended to agree that 
the case waS complex but solvable. Subjects slightly agreed 
(mean = 4.583) that the case study content was realistic. 


Subjects agreed (mean = 5.417) that the case scenario could 
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be an example of an actual decision situation. However, 
comments made by DGDSS subjects suggested they had 
a@ifficulty visualizing themselves as participants in 
decisions of this nature. Of the DGDSS subjects, 13.6 
percent commented that they lacked the expertise in security 
affairs to effectively address the case problem. 

Although a case of greater complexity was considered 
for this study, authors felt that too much difficulty could 
overwhelm the subjects, making it difficult for them to 
arrive at a solution. 

2. Case Suitability for DGDSS/Traditional Settings 

Case Suitability refers to subjects! feelings about 
how well the case study was suited for the decision 
environment--distributed GDSS or traditional face-to-face. 
DGDSS and traditional subjects were asked the extent to 
which they agreed that the case lent itself well to their 
respective decision environments--DGDSS or face-to-face. 

Traditional Subjects were significantly more likely 
to agree than DGDSS subjects (at p < 0.05) that the case was 
Suitable for their group decision making environment. DGDSS 
subjects slightly disagreed (mean = 3.318 and traditional 
subjects slightly agreed (mean = 5.357) that the case was 
suited for group decision making with a distributed GDSS 
(p = .0001). See Table 4.2. 

As mentioned earlier, our case study was a semi- 


structured crisis situation matching the description of 


ORs: 


TABLE 4.2 | 


MEANS AND STANDARD DEVIATIONS FOR CASE SUITABILITY . 








DGDSS TRADITIONAL 
Mean SD Mean SD Probe 
Case Suitability S25 1 L615. 95.352 11 Se -0001 


"high relationship, low task" presented by Suchan, Bui and 
Dolk [Ref. 17}. DGDSS subjects! comments add credence to 
the contention of Suchan, Bui and Dolk that subjects would 
gain little service from GDSS for high-relationship, low- 
task problems [Ref. 17:pp. 444-445]. DGDSS subjects 
(40.9 %) commented that DGDSS would be better used in 
situations where time was not a critical constraint. 
Considering that DGDSS subjects had past experience with 
traditional decision making and their comments concerning 
time critical situations, the following can be inferred: 
(1) group decision makers prefer having personal interaction 
for crisis decisions such as those required by the case 
study--safety of human life/time sensitive; and (2) the case 
would have been better solved face-to-face. 

3. Decision Satisfaction/Confidence/Commitment 

Also mentioned earlier, only three of six DGDSS 

groups arrived at a final solution--two groups ran out of 


time and one had a system failure. This reduced the sample 
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size from 22 to 11 for DGDSS questions concerned with a 
final decision/solution. 
a. Decision Satisfaction 
The level of group member decision satisfaction 
was determined by evaluating the extent to which subjects 
agreed with the following statements: 
- My group devised a good solution to the case. 


- Iam satisfied with the final result derived from my 
group's inputs. 


Additionally, subjects were asked how satisfied or 
Gissatisfied they were with the quality of their group's 
solution. 

There was not a Significant difference in 
decision satisfaction between DGDSS and traditional groups. 
Table 4.3 shows that DGDSS subjects were more inclined than 
traditional subjects to agree that they had devised a good 
solution (mean = 5.000 and 4.500 (p = .2121) respectively). 
Although DGDSS and traditional subjects slightly agreed that 
they were satisfied with their final solution, DGDSS 
subjects showed slightly more satisfaction than traditional 
subjects (means = 4.929 and 4.455 respectively, p = .2559). 
DGDSS and traditional subjects were slightly satisfied 
(means = 5.143 and 4.818 respectively, p = .2815) with the 
quality of their final solution; however, traditional 


subjects were slightly more satisfied than DGDSS subjects. 


5 


TABLE 4.3 


MEANS AND STANDARD DEVIATIONS FOR 
DECISION SATISFACTION 





DGDSS TRADITIONAL 
Decision Satisfaction Mean SD ean SD Prob. 
Good Solution 5.000 1.622 4.500 1.454 ~2iZzi | 
Final Result 4.929 1.492 4.455 2.067 255g 
Quality 4.818 1.601 5.143 de ko) . 2a 
b. Decision Confidence 


Subjects were asked to what extent they were 
confident that their group's solution was correct. There 
was no significant difference between the two groups at 
p < 0.05. Traditional and DGDSS groups indicated that they 
were, to some extent confident with the final decision 
(means = 4.857 and 4.636 respectively, p = .3349). However, 
traditional groups were slightly more confident than DGDSS 


groups. See Table 4.4. 


TABLE 4.4 


MEANS AND STANDARD DEVIATIONS FOR 
DECISION CONFIDENCE 








DGDSS Traditional 
Mean SD Mean SD Prob. 
Decision Confidence 45636 = leo 4.857 1.167 73446 
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This finding is consistent with Gallupe's for GDSS: "groups 
who used the GDSS were slightly less confident in the 
decision they had made compared to other groups." [Ref. 3:p. 
219] Gallupe explains this response as reflecting "post- 
decision apprehension": 

Groups supported by the...GDSS...({tend] to generate 
more possible decision alternatives. They also [consider] 
those alternatives in more detail. Because of this 
condition, these groups [have] a more difficult choice to 
make, and once they [make] a decision, they [are] possibly 
less confident because of the number and quality of the 
@mnoices. [{Ref. 3:p. 291) 

Although decision quality was not measured, 
"pnost decision apprehension" may apply to the DGDSS groups 
in this study since they were inclined to generate large 
quantities of information. 
c. Decision Commitment 
Decision commitment was measured in two ways; 
subjects were asked the extent to which they felt: 


- committed to the group's solution. 


- personally responsible for the correctness of the group 
solution. 


Traditional subjects exhibited significantly 
more commitment than DGDSS subjects to the final decision. 
Traditional subjects were committed to some extent 
(mean = 5.357) to the final decision and DGDSS subjects 
again were not sure (mean = 4.364, p = .0117). Additional- 
ly, traditional subjects felt slightly more responsible for 


the correctness of the group's solution than DGDSS subjects. 


WD) 


Traditional subjects indicated that they felt, to some 
extent (mean = 5.0) responsible for the correctness of the 
solution, DGDSS subjects were not sure (mean = 4.364). 
Although the difference was not significant at p < 0.05, it 


was Significant at p < 0.10 (p = .0986). See Table 4.5. 


TABLE 4.5 


MEANS AND STANDARD DEVIATIONS FOR 
COMMITMENT TO SOLUTION 


DGDSS Traditional 
Commitment to Solution Mean sD Mean SD Prob. 
Resp. for Correct 4.364 1.120 5.000 1.240 J F@o9age 
Committed to Solution 4.364 1.206 5.357 0.842 (30am 


Surprisingly, DGDSS groups expressed more 
agreement than traditional groups that they had devised a 
good solution, but less confidence in the decision. DGDSS 
groups also exhibited less willingness than traditional 
groups to commit to the decision. Lower levels of decision 
satisfaction and decision confidence account in part for 
their lower levels of commitment. The significance of these 
findings has implications about the future of DGDSS. If 
decision makers lack sufficient satisfaction, confidence, 
and commitment regarding group decisions, the decisions will 
not likely be implemented well--despite its quality. DGDSS 


design must guarantee favorable attributes and decision 
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maker sentiments such as decision satisfaction, decision 
confidence and commitment to the decision. Further research 
is needed to determine what factors contribute to decision 
satisfaction, confidence, and commitment. 
4. Satisfaction with Decision Process 
Subjects were asked the extent to which they agreed 
to the following statement: 


- Iam satisfied with the decision making process my 
group used to develop a final solution. 


Traditional subjects! responses indicated 
Significantly more satisfaction (p = .0190) than DGDSS with 
the decision process. Traditional subjects slightly agreed 
(mean = 5.143) that they were satisfied with the decision 
process. DGDSS subjects gave a neutral response (mean = 


4.300). See Table 4.6. 


TABLE 4.6 


MEANS AND STANDARD DEVIATIONS FOR SATISFACTION 
With DECISION PROCESS 





DGDSS Traditional 

Satisfaction with Mean SD Mean SD Prob. 
Decision Process 

Decision process asOle 1.26) $543 028649020190 
BPEficiency 3.476 0.928 4.529 O16 -0036 
Coordination BO 50.9444. 929° 50.616 ..0005 
Understandability 22266. °°0;.902Z 5.214 0.426 -VOO5 
Fairness 4.8357 @@..573.5.214 Ou579 -0406 
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Overall findings show that DGDSS groups were less 
satisfied with decision process than traditional groups. 
This is consistent with Gallupe's finding for GDSS: "GDSS 
support resulted in significantly lower level of 
satisfaction with the group decision making process." [Ref. 
3:p. 291] To attempt to isolate reasons for subjects' 
responses, researchers addressed the areas of group process 
efficiency, coordination, understandability, and fairness. 
Table 4.6 shows that traditional subjects felt their 


decision process was significantly more: 


- efficient: traditional/DGDSS means = 4.429/3.476 
- coordinated: traditional/DGDSS means = 4.929/3.905 
- understandable: traditional/DGDSS means = 5.214/4.286 
- fairness: traditional/DGDSS means = 5.214/4.857 


Traditional groups felt that their group decision 
process was neither efficient nor inefficient, or were 
unsure (mean = 4.429). In contrast, DGDSS groups believed 
their decision process was inefficient (mean = 3.476). 
Traditional groups felt their decision process was 
coordinated (mean = 4.929) but DGDSS groups felt their 
decision process was neither coordinated nor uncoordinated, 
Or were unsure (mean = 3.905). Traditional groups felt 
their decision process was understandable (mean = 5.214) and 
DGDSS groups felt their decision process was neither 
understandable nor confusing (mean = 4.286). Both settings 


felt that their decision process was fair--providing equal 
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participation--(traditional mean = 5.214, DGDSS mean = 
4.857), but responses were significantly higher for 
traditional subjects. 

DGDSS groups gave significantly less favorable 
responses in all areas. Because of the highly structured 
process provided by the DGDSS, these responses were 
unexpected--particularly regarding efficiency and 
coordination. These negative responses were caused by 
problems that developed from use of DGDSS software 
(discussed in the following chapter on analysis of DGDSS 
software). DGDSS subjects comments indicated that waiting, 
caused by normal DGDSS program operation, and inability to 
effectively communicate or coordinate the session caused 
frustration and confusion. Other comments addressed 
software unreliability saying that the system "crashed 
easily" and “lacked features" such as editing, recalling of 
criteria and alternatives, message broadcasting, and input 
limiting, which explains lower evaluations for efficiency of 
decision process. 

The DGDSS program also lacked speed and robustness 
necessary for instant feedback and aggressive decision- 
making, qualities that Jelassi and Beauclair say mark 
decision makers' expectations of a system [Ref. 16:p. 151}. 

Some participants commented that the DGDSS decision 
process encouraged generation of excessive criteria and 


alternatives which became progressively more difficult to 
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Manage as the session continued. Although ranking was 
intended to reduce--for later phases of the decision 
process--the number of criteria and alternatives by 
excluding less desirable ones, this option was not used 
effectively; subjects preferred to retain the majority of 
their entries. Large numbers of criteria and alternatives 
slowed program operation and, if large enough, could bring 
the program to an apparent halt. As mentioned in the 
decision satisfaction evaluations, the large number of 
criteria and alternatives may also explain, in part, why 
DGDSS subjects were less committed and had less confidence 
with the final solution. A few DGDSS participants expressed 
their desire for qualities associated with personal 
interaction present in traditional settings and their 
dislike for the impersonal characteristics of DGDSS 
settings. 

5. Participation 

Subjects were asked to give their perceptions about 

group participation by indicating the extent to which they 
agreed with the following statement: 


- Everyone in my group had an equal chance to 
participate. 


- I gave information that helped solve the problem. 
Table 4.7 shows that there was no Significant 
difference in perception of equal participation among 


subjects at p < 0.05. Both traditional and DGDSS groups 
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TABLE 4.7 


MEANS AND STANDARD DEVIATIONS FOR PARTICIPATION 








DGDSS Traditional 
Participation Mean SD Mean SD Prob. 
Reflects my inputs Polis. 571 0.6460 .0349 
Equal Participation GeOSor lh. 353 590.071 ,1..592 wae oO 
I gave information Site 2 Ome. 7/24 0.611... .3430 


also agreed (means = 6.053 and 6.071 respectively) that they 
had equal chance to participate and perceived that they had 
given information (means = 5.571 and 5.714) to solve the 
problem. 

Subjects were asked to what extent the final 
solution reflected their inputs. Traditional subjects felt 
Significantly stronger (at p < 0.05) than DGDSS subjects 
that solutions reflected their inputs. Traditional subjects 
felt to a good extent (mean = 5.571) that the solution 
reflected their inputs, while DGDSS subjects only felt to 
some extent (mean = 4.800) that the solution reflected their 
inputs (p = .0349). 

Other than traditional subjects' feelings that their 
solutions reflected their inputs, there was no significant 
difference in subjects! perceptions about participation. 
Both groups felt that they contributed to solving the 
problem and also that there was equal opportunity to 


participate in the decision process. However, DGDSS 
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subjects had more difficulty seeing the impact of their 
inputs on the final solution. This may have resulted from 
being unable to monitor the direct influence of their 
contributions on the decision session as traditional 
subjects could. 

Facilitator observation revealed that traditional 
subjects dealt with issues rather than procedures. Issues 
were opened, discussed then closed or temporarily shelved 
for later discussion. Traditional subjects saw the 
reactions of other group members from the moment inputs were 
made to the forming of a consensus. On the other hand, 
DGDSS subjects made their inputs to the system and then 
quickly went on to other things, such as making more entries 
or browsing. DGDSS subjects could not be sure that others 
gave adequate consideration to their inputs. Additionally, 
calculations for scoring alternatives were not immediately 
observable to subjects. Subjects could not see the impact 
of their criteria weighing and alternatives scores on the 
final outcome. 

6. Communication Satisfaction 

Communication satisfaction was measured in three 
ways: method, quality and effectiveness of communication 
(Table 4.8). Subjects were asked to evaluate the adequacy 
of their communication method. Traditional subjects 
responded significantly more favorably (p = .0001) than 


DGDSS subjects. Traditional subjects felt that their method 
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TABLE 4.8 


MEANS AND STANDARD DEVIATIONS FOR 
COMMUNICATION SATISFACTION 





DGDSS Trade itona 
Comms. Satisfaction Mean SD Mean SD Prob. 
Method 3.636 ies 8 7 6.071 0.829 ~0001 
Quality 3. Oro J Uges Moje. 5.929 0.730 ~0001 
Effectiveness 32545 liesed 72. 5.929 0.616 ~O0001 


of communications was adequate (mean = 6.071) and DGDSS 
subjects felt that theirs was neither good nor bad (mean = 
3.636). 

Subjects were asked to evaluate the quality of their 
session communication. Traditional subjects responded 
Significantly more favorably (p = .0001) than DGDSS 
subjects. Traditional subjects felt their session 
communication was of good quality (mean = 5.929) and DGDSS 
subjects felt that theirs was neither good nor bad 
(mean = 3.810). 

Subjects were asked to evaluate the overall 
effectiveness of their groups communication. Again, 
traditional subjects responded significantly more favorably 
(p = .0001) than DGDSS subjects. Traditional subjects felt 
that communication was effective (mean = 5.929) and DGDSS 
subjects felt that communications were only partially 


effectively (mean = 3.545). See Table 4.8. 
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Aside from case suitability, the most significant 
difference between the two settings was exhibited regarding 
communication satisfaction. DGDSS subjects gave 
Significantly less favorable assessments than traditional 
subjects in all three areas. The reason for this reaction 
can best be summed up by comments offered by DGDSS subjects: 


- Inability to match messages with their appropriate 
replies. 


- Inability to address messages to all members of the 
group simultaneously. 


- Inability to simulate conversational discussion through 
message exchange. 


- Electronic message sending was too slow and difficult. 


- Message sending facility did not allow adequate space 
for clear communication to take place in one message. 


Our findings highlight the importance of 

communications in the design of DGDSS features. 
7. Competence of the Experiment 

Subjects were asked how competently the facilitators 
had conducted the experiment. The difference in responses 
waS Significant at p < 0.05. Traditional subjects felt the 
experiment was smoothly executed, whereas DGDSS subjects 
felt the experiment was executed with slightly below average 
professionalism (traditional/DGDSS means = 4.786/3.773, 
p = .0069). See Table 4.9. The most significant 
contributor to this assessment was the temperamental quality 


of the software. 


86 


TABLE 4.9 


MEANS AND STANDARD DEVIATIONS FOR 
COMPETENCE OF EXPERIMENT 


DGDSS Traditional 
Mean SD Mean SD Prob. 
Experiment Competence 3.772 1.066 4.786 122510069 


8. Satisfaction with DGDSS Software 
Software satisfaction was measured in terms of 
perceived usefulness, ease of use, how understandable the 
steps of operation were, frustration/confusion caused by 
using the software, and ease in learning to use the 
software. Table 4.10 gives the mean of responses given by 


DGDSS subjects. 


TABLE 4.10 


MEAN AND STANDARD DEVIATION FOR 
SOFTWARE SATISFACTION 





SW Satisfaction Mean SD 

Usefulness 2.619 1204 
Ease of use 4.143 Pe2s6 
Understandability ve to 5S 
Frustration free 3.619 1.396 
Ease to learn 42952 0.740 


Software usefulness was measured by asking subjects 
if they would be willing to use the experimental version of 


the DGDSS again for other decision meetings. Responses 
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showed little desire to use the system for some decision 
meetings and that subjects would only use the system 
sometimes (mean = 2.619). However, this result was probably 
due to the temperamental nature of the software and the 
dissatisfaction with communications offered by the system. 
DGDSS subjects gave a neutral response in regard to the 
software's ease of use (mean = 4.143) and their ability to 
understand how to use it (mean = 4.143). 

DGDSS subjects were asked how easy the DGDSS program 
was to learn. Subjects responses indicated that learning to 
use the system was easy (mean = 4.952). 

When asked if they were frustrated by using the 
DGDSS program, subjects indicated that the software caused 
some frustration (mean = 3.619). Observations showed that 
subjects were often preoccupied with questions about the 
DGDSS-program operation and decision process--rather than 
the decision problem. This finding was similar to that of 
Watson, who determined that "groups became overly concerned 
with procedural matters" as opposed to the issues [Ref. 
20:p. 474]. The current study's DGDSS subjects agreed that 
even though learning to use the system was easy, the 
software caused some frustration. Many of the comments on 
software performance addressed slow system operating speed 
(25%), lack of system capabilities (18.7%), and system 
unreliability (28%). These issues will be discussed in the 


following chapter on analysis of DGDSS software. 


88 


D. 


CONCLUSIONS 


Results from the testing of the experimental prototype 


DGDSS software program on subjects in a simulated 


distributed geographical setting most definitely 


demonstrated that many improvements in the prototype would 


be needed before any further testing takes place. 


Furthermore, both the observation and data as well as 


the questionnaire results proved the following: 


That the most desirable DGDSS user capability was the 
anonymity in information generation, while the most 
needed DGDSS user capabilities which were not provided 
were: 


* an artificial limitation on the number of criteria 
and alternatives generated. 


* enhanced editing to include criteria and 
alternative titles. 


* criteria description recall during the scoring 
phase, and enhanced communications to include 
message broadcasting. 


The design of the DGDSS disrupted the decision making 
process due to software slowness, an inadequate 
communication capability that also affected the ability 
to coordinate the decision process, unreliability of 
software, and lack of needed capabilities. 


The potential of the DGDSS to provide better decision 
quality cannot be ascertained by this study since half 
of the DGDSS groups never arrived at a solution. 


The DGDSS does have the potential to increase decision 
maker participation as demonstrated by the large 
average number of criteria and alternatives generated 
during the current study's DGDSS group testing. 


The experimental prototype DGDSS software will require 


many improvements in-order to be of assistance to 
decision makers in a distributed setting. 
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- Our DGDSS is of little assistance to decision makers 
faced with a problem having a time sensitive/critical 
and highly emotional nature to them. 

- DGDSS decision groups were less committed to and less 
satisfied with the final group solution, less satisfied 
with the decision process, and less satisfied with the 
communications, than the traditional decision groups. 

This chapter discussed the results of testing for DGDSS 
and traditional settings. The next chapter will discuss the 
significant strong points and weaknesses of the DGDSS 


software program used in this study. 
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V. ANALYSIS OF DGDSS SOFTWARE 


To determine the potential usefulness of any newly 
developed DGDSS software, testing must be done to assess the 
benefits and problems associated with the software. Through 
this process, necessary improvements can be identified and 
incorporated into the DGDSS prior to system delivery to the 
customer. 

As stated in the Introduction, the DGDSS software 
program used in this research is an experimental prototype. 
As demonstrated by the DGDSS users responses' to the 
questionnaire and the facilitator's observations of the 
DGDSS decision sessions, both beneficial qualities and 
annoying problems were discovered in the DGDSS software when 


conducting this research. 


A. BENEFICIAL QUALITIES 

The DGDSS software prototype offered many capabilities 
that proved to help users in the decision session. Those 
which had the greatest impact on the users were anonymity, 
menus, and user friendliness. 

1. Anonymity 

The DGDSS software enabled users to anonymously 

generate criteria and alternative input, rank the input, 


weigh the criteria, and score the alternatives with respect 
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to the criteria. This anonymity allowed all users to 
participate in the decision making process in a very 
uninhibited manner. As a result, numerous criteria and 
alternatives (when possible) were generated by the users in 
each DGDSS decision session conducted. The existence of 
peer pressure or a dominating group member was not apparent 
in any of the DGDSS sessions. 
2. Menus and User Friendliness 

The DGDSS software was created to be menu driven 
throughout the entire decision session. By doing so, users 
could move from one section of the decision session to 
another by using a few keystrokes. This capability reduced 
the need for extensive explanation on use of the DGDSS 
software, provided the user with an easy program structure 
to learn, and impressed the participants as a system that 


was user friendly. 


B. PROBLEMS 

Many problems with the DGDSS software were encountered 
by the research participants. As discussed in the 
Literature Review, when users have expectations about the 
software capabilities that are not met, frustration can 
occur which may result in less use of the GDSS. By 
uncovering this problem early in the development of the 
DGDSS, corrections can be made to either the software or the 


user's perception. 
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1. Slowness of Software 

The DGDSS software was very slow. This problem 
progressively worsened as the decision makers proceeded 
through the decision making process. Group members 
commented on their frustration in waiting for the screens to 
change, delays in moving through menus, and length of time 
to obtain the calculated results of the session. An example 
of this problem was a DGDSS session that had four 
participants who collectively entered 15 criteria and 22 
alternatives. Although through group consensus a cut-off on 
criteria and alternatives could be established after the 
ranking phase of each, participants chose not to impose one 
thus using all of the criteria and alternatives in the 
scoring phase. After the scoring phase of the decision 
making process, it took 40 minutes for the DGDSS software to 
compile and calculate a final group solution. 

2. Communications 

Users found the DGDSS' communications capability to 
be less then desirable and extremely cumbersome. Although a 
message sending and receiving capability was provided to 
each user, there was no ability to send one message 
Simultaneously to all group members (broadcast). This 
required the user to either send out three identical 
messages or contact the facilitator and request that the 
facilitator broadcast the message to other group members. 


Obviously, the DGDSS communications slowed down the decision 
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process by increasing the time it took to communicate 
between decision makers. 

The inadequate message sending capability coupled 
with the anonymous generation of input resulted in increased 
decision maker frustration when clarification of displayed 
information was needed. Instead of sending out identical 
messages to other group members, the decision maker either 
asked the facilitator to broadcast a message or used 
personal inferences to understand the information. In turn, 
each of these choices for obtaining clarification led to 
further problems. 

By uSing the facilitator to relay messages, other 
message traffic to the facilitator had to wait, including 
messages of greater importance such as a participant getting 
stuck or being dumped out of the decision session by the 
software. 

When the participants chose to clarify the 
information on their own, redundancy of generated 
criteria/alternatives occurred. Consequently, this created 
a catch-22 situation. Either decision makers would have to 
use the message system to discuss the combining of similar 
information or they could leave all the information intact 
which made the scoring of alternatives to criteria a long 
arduous process. 

This is not to say that some of the criteria and 


alternatives could not have been eliminated during the 
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ranking phases by the establishment of a cut-off. The 
capability to eliminate criteria and alternatives below a 
chosen rank percentage was provided by the DGDSS. However, 
for decision makers to use this capability, a consensus by 
all group members had to be accomplished; and, the only way 
a consensus could be reached was by using the message 
system. Usually, by the time the decision makers had 
progressed to the point of ranking the criteria, they were 
thoroughly frustrated by the message system's limitations 
and preferred to just go on to the next phase of the 
decision process. By choosing to forego the opportunity to 
establish a cut-off, each group ended up with a large number 
of alternatives to rank against a large number of criteria. 
Ss. Tnflexibyrlity 

The DGDSS software provided very little flexibility 
to the group members. An example of this inflexibility was 
the system's reaction to a group member who entered an 
incorrect character while generating criteria or 
alternatives. 

For a decision maker to add criteria or 
alternatives, he/she would enter the respective "Add" menu 
module and the screen would display a blank file card with a 
distinct header space for the title of the criteria/ 
alternative. The decision maker could only enter letters 


into this space. Any attempt to enter a number or special 
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character resulted in the software moving the decision maker 
to the space allocated for the criteria/alternative 
description regardless of whether the title of the 
criteria/alternative was completed on the file card. 
Complicating this problem was the editing capability of the 
software. 

The decision maker could edit the title of the 
criteria/alternative only during the time it was being 
created and only by using the delete key. Attempting to use 
the backspace key caused the same results as uSing a special 
character key. After the criteria/alternative title was 
created, there was no way to edit it. This left the 
decision maker with three choices. He/she could ask the 
group for a consensus on having the criteria/alternative 
combined with another that was similar, or tell the group 
members to disregard it as a mistake, or attempt to clarify 
the title of the card in the space provided for the 
description. 

Using this final choice for a mistake on a criteria 
title led to total confuSion in the scoring phase. This 
occurred because the DGDSS software did not provide the 
capability to recall the criteria description when scoring 
the alternatives to the criteria. The inability to view 
criteria description frustrated the decision makers even 
further when they realized they had numerous criteria to 


deal with. 
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4. Software Fragility 


Many times if the user hit the wrong key when trying 
to send a message or use the function keys, the DGDSS 
software would dump them out of the decision session. This 
resulted in the group member having to restart the program. 
This restarting sometimes inadvertently caused an additional 
problem of the user logging into the same decision session 
twice, which resulted in a total DGDSS software collapse 
during the next immediate compiling phase of the session. 

To restart the session, the facilitator had to go into the 
DGDSS software file containing the names of the decision 
makers for the respective session and delete the additional 
logged-in decision maker's name. Then all decision makers 
would have to restart the decision session. 

In addition to the time delay in correcting this 
problem, all rankings or weights and scoring would have to 
be reentered by the group members on criteria, alternatives, 
or both, depending upon which decision making phase the 
DGDSS software crashed in. However, not all mistakes 
resulted in a group member crashing the DGDSS software or 
the user being dumped out of the decision session. There 
were incidents where a decision maker would get locked into 
a menu and the facilitator was able to correct the problem. 

Another distressing situation was the inability of 
the DGDSS software to compile, calculate, and display ranks 


or scores with the group members remaining in the respective 
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menu. After group members' released their rankings or 
scores for compiling, it was necessary for them to "back- | 
out" of the respective menu to the main menu. If any member 
failed to either release their ranks/scores or back-out of 
the module, the DGDSS crashed and required all decision 
makers to restart the session and reenter the ranking/ 
scoring. 
Other observed problems with the DGDSS software 
included the following: no on-line "Help" capability, 
Function keys for Alternative "Comment" and "Note" 
capabilities being mislabeled, numerous typographical errors 
on the display menus, and limited character space for 


messages. 


C. SOFTWARE IMPROVEMENTS 

One of the questions that this study addresses is, if 
the DGDSS software can be improved to provide better 
assistance to decision makers ina distributed setting. We 
believe that it can be improved by correcting the software 
code and adding some additional capabilities. Recommended 
improvements for each software problem presented as well as 
other DGDSS decision making features will be discussed. 

1. Communications 

The communications component is one of the most 

important design capabilities in a DGDSS. This has been 


stated in previous research and is evident in the present 
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study. Necessary improvements to the DGDSS software 
communications component include providing the group 
decision makers with the ability to create longer messages 
and to broadcast messages. 

It is difficult to predict what would be the best 
message space allocation in a DGDSS. The message space 
provided by this DGDSS was less then 120 characters. It was 
demonstrated both in the responses to the questionnaire and 
through observations by the facilitator that the prototype 
aid not provide enough space for some of the decision makers 
to clearly express their thoughts in one message. In future 
versions of this DGDSS software, Message space should be 
expanded considerably, perhaps to an entire screen. By 
doing so, the decision maker will not have to waste time 
thinking about how they are going to abbreviate their 
thoughts to fit them into one message. 

The message broadcasting capability is already built 
into the DGDSS prototype but was not used in this study by 
the group members. This was because it failed to work 
correctly and resulted in repeated "locking-up" of the 
software. At first the researcher felt this locking-up was 
due to group member inexperience because the facilitator had 
no problem broadcasting messages from his work station. So 
to check this theory, the facilitator attempted to broadcast 
a message from the user work-station which produced the same 


results experienced by the group member. This led the 
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researcher to believe the problem is in the user software 
coding of the broadcast capability. The problem should be 
correctable since the broadcast capability works in the 
facilitator's software. 
2. Software Speed 

There are many unknowns that may have caused the 
lack of speed in the software. An initial possibility is 
the coding of the software. Using mathematical algorithms 
that are inefficient would cause a slowness in calculating, 
but it would not explain the progressive slowdown of the 
software as the group members progressed through the 
decision session. It is possible that the languages used in 
coding are not efficient for a DGDSS application. Another 
possibility is that the network used in conducting this 
DGDSS research is inefficient. Regardless of the cause of 
the slowness, the speed of the DGDSS software must be 
improved immensely for this DGDSS prototype to have any 
potential future. 

32~ \Elexip ey 

The inflexibility can be corrected by both altering 
the code and adding capabilities. The DGDSS software could 
be coded to not allow entry of a special character into the 
criteria/alternative title field without moving the decision 
maker to the description screen. This coding could 
incorporate sound to alert the decision maker of an 


incorrect entry. 
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The software could also be improved by providing the 
decision maker with the capability to review criteria 
description during the scoring phase. This capability could 
be built into a function key and would probably result in 
less decision maker frustration in the scoring phase, 
especially if faced with numerous criteria. 

Providing the capability to go back and edit the 
criteria/alternative title may not be possible since it 
would allow a single decision maker to delete public 
information. Granted, the title was originated by the lone 
decision maker who would be able to edit it, but the title 
becomes public information once it is displayed to all group 
members. A limited editing capability should be made 
available to the decision maker for use prior to releasing 
the title for public display. 

4. DGDSS Fragility 

The fragility of the prototype can only be improved 
by both altering the software code and adding more 
capabilities. By making the software more robust, some of 
the time delays and user frustrations experienced in this 
study will be lessened in future studies. Furthermore, 
these improvements can make it possible to conduct a more 
in-depth study of how well this prototype assists the group 
decision makers throughout the entire decision making 


process. 
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The software should not be so fragile that a 
decision maker gets locked-up in the DGDSS trying to use a 
function key. This is probably a correctable error in 
coding. It should be unnecessary for all group members to 
have to back-out to the main menu for the software to do the 
calculations. This can also be corrected by altering the 
code. 

Capabilities should be built into the software that 
would alert the facilitator when either a decision maker 
failed to release their rank/scores or a group member logged 
into the decision session twice. 

5. Additional Areas Where Improvements are Recommended 

The DGDSS software could also be improved by 
incorporating the capability to artificially limit the 
number of criteria and alternative that any one group member 
can input. This capability should be dynamic so that it can 
be turned off when the DGDSS decision making session 
requires unlimited brainstorming. Although this capability 
may provide similar results as the group using a consensus 
cut-off during the criteria/alternatives ranking phases, an 
artificial limit may prove to be more helpful if solution 
time is critical or the group members are known for being 
unable to arrive at a consensus. 

Other recommended improvements to the DGDSS software 
are the creation of an on-line help facility, correction of 


typographical errors in the menus, the coding of the 
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function keys to provide identical capabilities throughout 
each phase of the decision process, and adding color to the 
displays. 

To conclude, the experimental prototype DGDSS 
software program used in this study had both beneficial 
qualities and problems. The beneficial qualities discussed 
were user friendliness, menus, and anonymous information 
generation. Also discussed were the software problems which 
included execution slowness, inadequate communications 
capability, software inflexibility, and software fragility, 
as well as recommended software improvements which would 
eliminate all of the problems. Finally, additional areas 
for improvements were suggested. Through this evaluation of 
the experimental prototype DGDSS software used in the 
current study, it should be evident that although the 
prototype has the potential to assist decision makers in a 
geographically distributed decision making setting, the 
extent of the potential cannot be measured until the 


software improvements are made. 
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VI. CONCLUSIONS 


A. DISCUSSION 
This chapter summarizes the case study test results, the 
prototype DGDSS software evaluation results, and the 
significance of the test results and software evaluation in 
terms of the research questions proposed in the 
Introductivoene- 
1. Case Study Test Results 
To summarize, the case study tested two distinct 
groups of decision makers: four groups in a traditional 
face-to-face decision making setting and six groups in a 
Simulated geographically distributed decision making 
setting. The task type used was crisis planning with a high 
degree of difficulty. Results of the case study testing 
were obtained through observation and data, and participant 
responses to a questionnaire. By combining these two 
methods, an accurate portrayal of the testing was obtained. 
a. Observation and Data 
The facilitator observations were made during 
each traditional and DGDSS group decision session. 
Additionally, the facilitator recovered data from DGDSS 
files and from traditional group solution forms. Through 
the observation and data, the following pertinent 


information was found: 
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Traditional groups reached a solution twice as fast 
DGDSS groups. 


DGDSS groups generated a larger number of criteria/ 
alternatives which they chose to keep through the 
scoring phase. In contrast, the traditional group 
generated a large number of criteria/alternatives but 
chose to limit the total number that would be submitted 
on the group solution form. 


DGDSS groups had many problems with the experimental 
prototype DGDSS software including limited 
communication capability, inflexibility, progressively 
decreasing software processing speed, and software 
fragility, all of which resulted in user frustration. 


Only three of the six DGDSS groups reached a solution, 
while all of the traditional groups reached a solution. 


Of the seven groups to reach a solution, only one of 
the DGDSS groups and none of the traditional groups 
reached the experts' solution; however, decision 
quality was not measured in this study. 

b. Questionnaire Responses 


Both the traditional and DGDSS groups were asked 


to fill out a questionnaire at the completion of their 


respective decision sessions. Questionnaire responses were 


tabulated to obtain the average response from all 


traditional and DGDSS group participants. The results of 


the questionnaire demonstrated the following: 


DGDSS members did not feel that the case problem 
scenario used wasS Suitable for a geographically 
distributed decision making environment. 


DGDSS members that did reach a final solution were more 
satisfied than traditional group members with the final 
group solution. 


Traditional members were more committed to the group's 
final solution. 


Traditional members were more satisfied with the 
decision making process. 
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- Traditional members more readily agreed that the 
solution reflected their personal inputs. 


- Both traditional and DGDSS group members felt that the 
ability to participate was fair, and that they 
personnally offered information. 

- Traditional members were significantly more satisfied 
with the communication in their decision making 
setting. 


- DGDSS members had little desire to use the DGDSS 
software for other group decision meetings. 


- DGDSS members were frustrated in using the DGDSS 
software. 


c. Combined Testing Results 
Combining the observation and data test results 
with the responses from the questionnaire clearly 
demonstrates that the experimental prototype DGDSS software 
hindered the groups! decision making process. Furthermore, 
Since the DGDSS group had no choice but to rely on the 
prototype DGDSS software to reach a solution, it can be 
inferred that the DGDSS software used in this study severely 
inhibited the researchers' ability to accurately measure the 
potential of a DGDSS to assist in a geographically 
distributed group decision making process or its potential 
to improve decision quality. 
2. Software Evaluation 
The evaluation of the experimental prototype DGDSS 
software illustrated the beneficial qualities, problems, and 


recommended improvements. 
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a. Beneficial Qualities 

The DGDSS did possess a few characteristics, 
anonymity, menus and user friendliness, that were viewed by 
the group decision makers as being very beneficial in the 
decision making process. 

The ability of the DGDSS to provide anonymous 
information generation allowed the decision makers to enter 
criteria, alternatives, ranks, weights, and scores 
anonymously. Many decision makers felt this enhanced their 
ability to participate in the group decision making process 
since it allowed them to be less inhibited about the 
information they offered to the group. 

The DGDSS provided a menu driven program that 
allowed group members to move from one phase of the decision 
making process to another through the use of a few 
keystrokes. Group members found this to be very helpful 
Since it made learning the DGDSS operation very easy. 
Consequently, this ease of learning the DGDSS operation left 
the decision makers with the feeling that the software was 
very user friendly. 

b. Problems 

The DGDSS software had many major problems, 
including slowness, limited communications, inflexibility, 
and fragility. 


- As the decision making process progressed, the DGDSS 
processing speed progressively declined. 
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- The communication component did not allow decision 
makers to broadcast messages or offer adequate space to 
the decision maker to send out a message without 
abbreviating the message content. 

- The software did not allow users to make keystroke 
mistakes, edit in certain areas, or recall criteria 
descriptions during the scoring phase. 

- The software was so fragile that decision makers could 
get dumped out or locked out of the decision making 
process for minor keystroke mistakes. Additionally, an 
error by a decision maker trying to reenter the 
decision making process or failure of a decision maker 
to release ranks, scores, and weights, caused the 
software to crash. 

c. Recommended Improvements 

Improvements to the DGDSS were suggested in all 
of the problem areas presented above. Most of the 
improvements will require a correction of the DGDSS software 
code, while other improvements will require the addition of 
capabilities not presently offered in the experimental 
prototype DGDSS software, including increased message 
writing space, enhanced editing, unlimited description 
recall, and on-line help facility. Additionally, it was 
recommended that all typographical errors in the menus and 
mislabled functions be corrected. Consequently, it was 
evident that all problems with the DGDSS software could be 
corrected through code corrections or system enhancements. 

3. Significance to the Research Questions 


In the Introduction chapter, the following research 


questions to be answered by this study were presented: 
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- Which DGDSS user capabilities are most desirable? 
- Which DGDSS user capabilities are most needed? 


- Does the design of the DGDSS enhance or disrupt the 
decision process? 


- Does the DGDSS have the potential to provide better 
decision making quality and increased decision maker 
participation? 


- Can the DGDSS be improved to provide better assistance 
to decision makers in a distributed setting? 


Although the test results and software evaluation 
demonstrate many shortcomings in the experimental prototype 
DGDSS software, answers to many of the research questions 
are provided as follows. 

The most desirable DGDSS user capability is the 
anonymity in information generation, while the most needed 
DGDSS user capabilities are: an artificial limitation on 
the number of criteria and alternatives generated, enhanced 
editing to include criteria and alternative titles, criteria 
description recall during the scoring phase, and enhanced 
communications to include message broadcasting and adequate 
message space. 

The design of the experimental prototype DGDSS 
disrupted the decision process due to software slowness, an 
inadequate communication capability that also affected the 
ability to coordinate the decision process, unreliability of 


software, and lack of needed capabilities. 
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The potential of the DGDSS to provide better 
decision quality cannot be ascertained by this study since 
half of the DGDSS groups never arrived at a solution. 

The DGDSS does have the potential to increase 
decision maker participation as demonstrated by the large 
average number of criteria and alternatives generated during 
the current study's DGDSS group testing. 

The experimental prototype DGDSS software will 
require many improvements in order to be of sufficient 


assistance to decision makers in a distributed setting. 


Be CONCLUSION 

Although the experimental prototype DGDSS software used 
in this study limited the ability to obtain general and 
all-encompassing answers to the DGDSS research questions 
purposed, it did provide valuable information on DGDSS 
design mistakes that can alter future DGDSS study attempts 
and severely cripple any possible implementation of the 
DGDSS into the business sector. Furthermore, it needs to be 
restated that the experimental prototype DGDSS software used 
1s correctable and must be improved before any future 
geographically distributed decision session studies are 
conducted. 

Finally, under different circumstances, such as 
incorporation of better DGDSS software incorporated, less 


time sensitive decision problem, and more decision maker 


1A, 


experience in the problem faced, a DGDSS can be of 
assistance to group decision makers in a geographically 
distributed setting. However, further research on the DGDSS 


is recommended to measure the level of the assistance. 


el 


APPENDIX A 


QUESTIONNAIRE 


The following questionnaires were used for DGDSS and 


Traditional Sessions. 


deleZ 


QUESTIONNAIRE: GDSS 
(Adapted from Hughes and Webb, Watson) 


BACKGROUND INFORMATION 


Please answer the following questions. 


l. Age years 

ee Sex: __F __M (check one) 

3. Branch of service: __ Navy __ Marine __ Army 
_. Coast Guard __ Air force 

4. Number of years in service years 

5. Rank 


6. Your level of experience with working in groups (circle one) 


] 2 5 4 5 
|--------------- |---------------- |--------------- |---------------- | 
Very High Medium Low Very 
High Low 
7. Your level of experience making actual business/military decisions 


(circle one) 


] 2 3 4 5 
|--------------- |---------------- |--------------- |---------------- | 
Very High Medium Low Very 
High Low 
8. Your level of experience using computer systems 

] 2 8 4 5 
|--------------- |---------------- |--------------- |---------------- | 
Very High Medium Low Very 
High Low 


3 


SESSION 


Please respond to the following statements by circling the response that best 
matches your feelings toward the statement. 


1. Immediately after reading the case study, the correct solution was 
intuitively obvious to me. 


] 2 3 a 5 6 7 

|------------- |------------ |------------- |------------ |------------ |------------- | 
Strongly Disagree Slightly Neutral Slightly Agree Strongly 
Disagree Disagree Agree Agree 


2. This case study could be an example of an actual decision making 


Situation. 

] 2 3 4 5 6 f; 
|------------- |------------ |------------- |------------ |------------ |------------- | 
Strongly Disagree Slightly Neutral Slightly Agree Strongly 
Disagree Disagree Agree Agree 

3. This case study seems unrealistic to me. 

] 2 5 - 5 6 d 
|------------- |------------ |------------- |------------ |------------ |------------- 
Strongly Disagree Slightly Neutral Slightly Agree Strongly 
Disagree Disagree Agree Agree 


4. This case lends itself well to a Distributed GDSS decision 
environment. 


] 2 3 + 5 6 ii 
|------------- |------------ |------------- |------------ |------------ |------------- | 
Strongly Disagree Slightly Neutral Slightly Agree Strongly 
Disagree Disagree Agree Agree 

ai I am satisfied with the number of alternatives my group identified. 
] Zz 3 ~ 5 6 il 
|------------- |------------ |------------- |------------ |------------ |------------- | 
Strongly Disagree Slightly Neutral Slightly Agree Strongly 
Disagree Disagree Agree Agree 
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6. JIam_ satisfied with the number of criteria my group identified. 


] 2 3 4 3 6 ¢ 

|------------- |------------ |------------- |------------ |------------ |------------- | 
Strongly Agree Slightly Neutral Slightly Disagree Strongly 
Agree Agree Disagree Disagree 


7. This Distributed GDSS software program is helpful in structuring 
my thoughts. 


] 2 3 4 5 6 i 

|------------- |------------ |------------- |------------ |------------ |------------- | 
Strongly Disagree Slightly Neutral Slightly Agree Strongly 
Disagree Disagree Agree Agree 


8. My group devised a good solution to the case. 


] 2 3 4. =) 6 fi) 

|------------- |------------ |------------- |------------ |------------ |------------- 
Strongly Agree Slightly Neutral Slightly Disagree Strongly 
Agree Agree Disagree Disagree 


9. I] am dissatisfied with the decision making process that my group 
underwent to develop a _ solution. 


1 2 3 4 5 6 7 

|------------- |------------ |------------- |------------ |------------ |------------- | 
Strongly Disagree Slightly Neutral Slightly Agree Strongly 
Disagree Disagree Agree Agree 


10. I am satisfied with the final result derived from my groups’ inputs. 


] 2 3 4 > 6 7 

|------------- |------------ |------------- |------------ |------------ |------------- | 
Strongly Disagree Slightly Neutral Slightly Agree Strongly 
Disagree Disagree Agree Agree 


Bal > 


11. The method for communicating with other group members was 


| 2 3 4 5 6 a 
|------------- |------------ |------------- |------------ |------------ |------------- | 
Unsatis- Inadequate Marginally Neither Marginally Adequate Satisfactory 
factory bad good nor good 
bad 


12. I feel personally responsible for the correctness of the group 


solution? 
1 2 3 4 5 6 7 
|------------- |------------ |------------- |------------ |------------ |------------- | 
Not at all Almost To a small Not To some Toa good To a great 
Nil extent Sure extent extent extent 


13. To what extent does the final solution reflect your inputs? 


] 2 3 4 5 6 7 
|------------- |------------ |------------- |------------ |------------ |------------- 
Not at all Almost To a small Not To some Toa good To a great 
Nil extent Sure extent extent extent 


14. To what extent are you confident that the group solution is correct? 


] Z 3 4 5 6 7 
|------------- |------------ |------------- |------------ |------------ |------------- | 
Not at all Almost To a small Not To some Toa good To a great 
Nil Extent Sure extent extent extent 


15. To what extent do you feel committed to the group's solution? 


] 2 3 + S 6 7 
|------------- |------------ |------------- |------------ |------------ |------------- | 
Not at all Almost To a small Not To some Toa good To a great 
Nil extent Sune extent extent extent 


16. How satisfied or dissatisfied are you with the quality of your group's 


solution? 
] Z 3 + 5 6 7 
|------------- |------------ |------------- |------------ |------------ |------------- | 
Very Dissatisfied Slightly Neither Slightly Satisfied Veny 
Dissatisfied Dissatisfied Satisfied Satisfied 


HG 


17. Not everyone in my group had an equal chance to participate. 


] 2 3 4 5 6 7 

|------------- |------------ |------------- |------------ |------------ |------------- | 
Strongly Disagree Slightly Neutral Slightly Agree Strongly 
Disagree Disagree Agree Agree 


18. The over all quality of the session communication was 


] 2 5 4 5 6 7 
|------------- |------------ |------------- |------------ |------------ |------------- | 
Very Good Good Adequate Neither Barely Poor Very poor 
Quality Quality Quality Good Acceptable Quality Quality 
nor Bad 


19. The communication, on the whole, was 


] 2 3 4 5 6 7 

|------------- |------------ |------------- |------------ |------------ |------------- | 
Very Effective Partially Neither Partially Ineffective VERY 
Effective Effective Ineffective Ineffective 


20. The decision session was 


] z 5 4 5 6 a 

|------------- |------------ |------------- |------------ |------------ |------------- 
Incompe- Clumsily Awkwardly Averagely Smoothly Competently Professionally 
tently Executed Executed Executed Executed Executed Executed 
Executed 


21. The group members submitted inputs on issues that were 


1 2 3 4 5) 6 th 

|------------- |------------ |------------- |------------ |------------ |------------- | 
Totally Mostly Partly Not Partly Mostly Totally 
Relevant Relevant Relevant Sure Irrelevant Irrelevant Irrelevant 


Ey, 


22. The interpersonal relationships among the participants 
appeared to be 


1 Z 3 4 5 6 q 

|------------- |------------ |------------- |------------ |------------ |------------- | 
Very Unhealthy Weak Not Firm Healthy Very 
Unhealthy Important Healthy 


23. My interest wandered during the group's decision making process. 


] ju 3 4 5 6 7 

|------------- |------------ |------------- |------------ |------------ |------------- | 
Strongly Disagree Slightly Neutral Slightly Agree Strongly 
Disagree Disagree Agree Agree 


24. I gave information to help solve the problem. 


] Z 3 4 5 6 7 

|------------- |------------ |------------- |------------ |------------ |------------- 
Strongly Disagree Slightly Neutral Slightly Agree Strongly 
Disagree Disagree Agree Agree 


25. I was not receptive to others’ inputs. 


] 2 3 4 5 6 7 

|------------- |------------ |------------- |------------ |------------ |------------- | 
Strongly Disagree Slightly Neutral Slightly Agree Strongly 
Disagree Disagree Agree Agree 


26. How would you describe your group's problem solving process? 


ae 2 3 4 5 6 7 
|------------ |------------ |------------- |------------ |------------ |------------- 
Extremely Very Eifierent Unsure/ Inefficient Very Extremely 
Eificient Efficient Neither Inéitievent Ineffieveme 

De 2 5 4 > 6 7 
|------------ |------------ |------------- |------------ |------------ |------------- ! 
Extremely Very Coordinated Unsure/ Un- Very Un- Extremely 
Coordinated Coordinated Neither Coordinated Coordinated Uncoor- 

dinated 
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26. (cont.) 


oa | 2 3 4 5) 6 i 

|------------ |------------ |------------- |------------ |------------ |------------- 
Extremely Very Under- Neither Confusing Very Extremely 
Under- Under- Standable Confusing Confusing 


Standable Standable 


d. 1 2 3 4 5 6 iy 
|------------ |------------ |------------- |------------ |------------ |------------- | 

Extremely Very Fair Unsure or Unfair Very Extremely 
Fair Fain Neither Unfair Unfair 

ec. | 2 3 4 5 6 i; 
|------------ |------------ |------------- |------------ |------------ |------------- | 

Extremely Very Satisfying Unsure or Dis- Very Dis- Extremely Dis- 

Satisfying Satisfying Neither Satisfying Satisfying Satisfying 


27. Would you use this experimental version of the computer system 
for group meetings? 


] 2 3 a 3 6 i 
|------------- |------------ |------------- |------------ |------------ |------------- | 
Never Seldom Sometimes Unsure Often Almost Always 

Always 


28. How easy to use was this experimental version of the computer 


system? 

] 2 3 4 S) 6 i; 
|------------- |------------ |------------- |------------ |------------ |------------- 
Impossible Very Difficult Neither Easy Very Effortless 
To use Difficult Easy To use 


29. I found the sequence of steps for operating this experimental 
version of the GDSS program to be 


] 2 3 ae 5) 6 yi 
|------------- |------------ |------------- |------------ |------------ |------------- | 
Totally Un-clear Slightly Neither Slightly Under- Clearly 
Confusing Un-clear Under- standable Under- 
standable standable 


aes 


30. The amount of frustration caused by using this GDSS program 
was 


None at all Almost Very little Unsure Some Significant Total 
None Frustration Frustration Frustration § Frustration 


31. Learning to use this GDSS program was 


] 2 3 4 5 6 7 

|------------- |------------ |------------- |------------ |------------ |------------- | 
Extremely Very easy Easy to Neither Hard to Very hard Extremely 
easy to to learn learn learn to learn hard to learn 
learn 


OVERALL IMPRESSION 


32. What factor, if any, would you say inhibited and/or encouraged your 
generation of inputs? 


33. Was this GDSS application program user-friendly? Why or Why 
nol! 


34. In what kind of decision making situation would you find this GDSS 
application program most useful? 


35. Briefly list any annoying, or beneficial qualities of the GDSS 
software program or GDSS decision session. (use bullets to save 
time). 


Comments: 
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QUESTIONNAIRE: NON-GDSS 
(Adapted from Hughes and Webb, Watson) 


BACKGROUND INFORMATION 


Please answer the following questions. 


l. Age years 
ee eX: ee ee | (check one) 
3. Branch of service: _ Navy _. Marine __ Army 
__ Coast Guard __Ajir force 
4. Number of years in service years 
5. Rank 
6. Your level of experience with working in groups (circle one) 
1 2 3 4 5 
|--------------- |---------------- |--------------- |---------------- | 
Very High Medium Low Very 
High Low 
7. Your level of experience making actual business/military decisions 
(circle one) 
1 2 3 4 5 
|--------------- |---------------- |--------------- |---------------- | 
Very High Medium Low Very 
High Low 
8. Your level of experience using computer systems 
l 2 3 4 5 
|--------------- |---------------- |--------------- |---------------- | 
Very High Medium Low Ney 
High Low 


raat 


SESSION 


Please respond to the following statements by circling the response that best 
matches your feelings toward the statement. 


1. Immediately after reading the case study, the correct solution was 
Intuitively obvious to me. 


1 2 3 4 5 6 7 
|------------- |------------ |------------- |------------ |------------ |------------- | 
Strongly Disagree Slightly Neutral Slightly Agree Strongly 
Disagree Disagree Agree Agree 
2. This case study could be an example of an actual decision making 

Situation. 

] 2 3 4 5 6 7 
|------------- |------------ |------------- |------------ |------------ |------------- | 
Strongly Disagree Slightly Neutral Slightly Agree Strongly 
Disagree Disagree Agree Agree 

3. This case study seems unrealistic to me. 

l Z 3 a 5 6 7 
|------------- |------------ |------------- |------------ |------------ |------------- | 
Strongly Disagree Slightly Neutral Slightly Agree Strongly 
Disagree Disagree Agree Agree 

4. This case lends itself well to a Face-to-Face decision environment. 
] 2 3 4 5 6 7 
|------------- |------------ |------------- |------------ |------------ |------------- | 
Strongly Disagree Slightly Neutral Slightly Agree Strongly 
Disagree Disagree Agree Agree 
5. J]am_ Satisfied with the number of alternatives my group 
identified. 

l Z 3 4 5 6 7 
|------------- |------------ |------------- |------------ |------------ |------------- 
Strongly Disagree Slightly Neutral Slightly Agree Strongly 
Disagree Disagree Agree Agree 


eZ 


6. Jam_ satisfied with the number of criteria my group identified. 


] Z 3 < 2 6 7 

|------------- |------------ |------------- |------------ |------------ |------------- | 
Strongly Agree Slightly Neutral Slightly Disagree Strongly 
Agree Agree Disagree Disagree 


7. This Face-to-Face group decision setting is helpful in 
Structuring my _ thoughts. 


] 2 3 4 > 6 7 

|------------- |------------ |------------- |------------ |------------ |------------- | 
Strongly Disagree Slightly Neutral Slightly Agree Strongly 
Disagree Disagree Agree Agree 


8. My group devised a good solution to the case. 


] 2 3 + 3] 6 i 

|------------- |------------ |------------- |------------ |------------ |------------- | 
Strongly Agree Slightly Neutral Slightly Disagree Strongly 
Agree Agree Disagree Disagree 


9. J am dissatisfied with the decision making process that my group 
underwent to develop a solution. 


] Z a 4 3 6 7 

|------------- |------------ |------------- |------------ |------------ |------------- | 
Strongly Disagree Slightly Neutral Slightly Agree Strongly 
Disagree Disagree Agree Agree 


10. IJ am satisfied with the final result derived from my groups’ inputs. 


] 2 3 4 2) 6 fi 

|------------- |------------ |------------- |------------ |------------ |------------- | 
Strongly Disagree Slightly Neutral Slightly Agree Strongly 
Disagree Disagree Agree Agree 
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11. The method for communicating with other group members was 


] 2 3 4 ) 6 qj 
|------------- |------------ |------------- |------------ |------------ |------------- | 
Unsatis- Inadequate Marginally Neither Marginally Adequate Satisfactory 
factory bad good nor good 
bad 





12. I feel personally responsible for the correctness of the group 


solution? | 

] 2 3 4+ 3) 6 7 | 
|------------- |------------ |------------- |------------ |------------ |------------- | 

Not at al] Almost To a smal] Not To some Toa good To a great | 

Ni] extent Sure extent extent extent 


13. To what extent does the final solution reflect your inputs? 


] 2 | 4 5 6 7 
|------------- |------------ |------------- |------------ |------------ |------------- | 
Not at all Almost To a smal] Not To some Toa good To a great 
Nil extent Sure extent extent extent 


14. To what extent are you confident that the group solution is correct? 


l Z & + 5] 6 i 
|------------- |------------ |------------- |~----------- |------------ |------------- | 
Not at all Almost To a small Not To some To a good To a great 
Nil extent Sure extent extent extent 


15. To what extent do you feel committed to the group's solution? 


] 2 3 4 5 6 7 
|------------- |------------ |------------- |------------ |------------ |------------- | 
Not at all Almost To a smal] Not To some To a good To a great 
Nil extent Sure extent extemt extent 


16. How satisfied or dissatisfied are you with the quality of your group's 


solution? 
] 2 3 4 5 6 7 
[freee tee ose (poe leceaceeeeeeee |------------ |------------ Seats == | 
Nery Dissatisfied Slightly Neither Slightly Satisfied Very 
Dissatisfied Dissatisfied Satisfied Satisfied 
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17. Not everyone in my group had an equal chance to participate. 

1 Z 3 4 5 6 7 
|------------- |------------ |------------- |------------ |------------ |------------- 
Strongly Disagree Slightly Neutral Slightly Agree Strongly 
Disagree Disagree Agree Agree 

18. The over all quality of the session communication was 
1 2 3 4 5 6 7 
|------------- |------------ |------------- |------------ |------------ |------------- | 
Very Good Good Adequate Neither Barely Poor Very poor 
Quality Quality Quality Good Acceptable Quality Quality 
nor Bad 


19. The communication, on the whole, was 


] Z 6) “ 5 6 7 
|------------- |------------ |------------- |------------ |------------ |------------- 
Very Effective Partially Neither Partially Ineffective Very 
Effective Eifective Ineffective Ineffective 
20. The decision session was 
] ) 3 4 5 6 7 
|------------- |------------ |------------- |------------ |------------ |------------- 
Incompe- Clumsily Awkwardly Averagely Smoothly Competently Professionally 
tently Executed Executed Executed Executed Executed Executed 
Executed 
21. The group members submitted inputs on issues that were 
] 2 3 4 5 6 7 
|------------- |------------ |------------- |------------ |------------ |------------- | 
Totally Mostly Partly Not Partly Mostly Totally 
Relevant Relevant Relevant Sure Irrelevant Irrelevant Irrelevant 
22. The interpersonal relationships among the participants 
appeared to be 
] 2 3 4 5 6 7 
eS 2 (peee tas aes |------------ |------------ |------------- | 
Very Unhealthy Weak Not Firm Healthy NCEY 
Unhealthy Important Healthy 


iS 


Strongly 
Disagree 


Strongly 
Disagree 


Strongly 
Disagree 


26. 


Extremely 
Efficient 


Extremely 


Extremely 
Under- 
Standable 


Extremely 
Fawr, 


My interest wandered during the group's decision making 


Disagree 


I gave 


Disagree 


I was not 


Disagree 


Very 


Efficient 


Very 


Very 
Under- 


Standable 


Slightly 
Disagree 


Slightly 
Disagree 


Slightly 
Disagree 


Efficient 


Coordinated 
Coordinated Coordinated 


Under- 
Standable 


Neutral 


Neutral 


Neutral 


Unsure/ 
Neither 


Unsure/ 
Neither 


Neither 


Unsure or 
Neither 


2G 


Slightly 
Agree 


Slightly 
Agree 


Slightly 
Agree 


How would you describe your group's problem 


Inefficient 


Un- 


Coordinated 


Confusing 


Unfair 


information that helped solve the problem. 


receptive to others’ suggestions and opinions. 


Agree 


process. 


Strongly 
Agree 


Strongly 
Agree 


Strongly 
Agree 


solving process? 


Very 


Very Un- 


Coordinated 


Very 
Confusing 


Very 
Unfair 


Extreme 
Inefficient 


Extremely 
Uncoor- 
dinated 


Extremely 
Confusing 


Extremely 


Unfair 


26. (cont.) 


e. | 2 3 = 5 6 7 
|------------ |------------ |------------- |------------ |------------ |------------- | 

Extremely Very Satisfying Unsure or Dis- Very Dis- Extremely Dzis- 

Satisfying Satisfying Neither Satisfying Satisfying Satisfying 


OVERALL IMPRESSION 


27. What factor, 1f any, would you say inhibited and/or encouraged your 
generation of inputs? 


Comments: 


eee, 


APPENDIX B 


CASE PROBLEM 


The North Koreans have voiced repeatedly their desires 
for a reunification of North and South Korea. They have 
consistently requested a withdrawal of all American troops 
from South Korean soil and all American influence in Korean 
affairs terminated. A growing number of South Koreans, 
particularly students, have become sympathetic to North 
Korean concerns. Rhetoric concerning the American presence 
and influence in South Korea has been increasing lately in 
South Korea, instigating disturbances by young South Korean 
students. These disturbances have become more numerous as 
well as increasingly more violent. Additionally, the 
students have focused their violence on Americans and their 
families working in South Korea. To complicate matters, a 
South Korean terrorist group has illegally crossed the 
borders into the United States and has systematically 
conducted terrorist activities against various targets 
Ine luda ne 

- The bombing of the Hydroelectric building at the 
Western division of the Morton Thyacol plant. 
Knowledge of the planned bombing was discovered through 
security sources. When company officials attempted to 
evacuate the plant, the terrorists detonated a bomb 
which damaged the building. There were no injuries or 
deaths reported in this incident. It is believed that 


the bomb was detonated by remote control. The 
terrorists were never apprehended. 


Ac 





- The taking of five hostages and subsequent damage to a 
School of Engineering building at Stanford University. 
One terrorist was killed, two people were injured, and 
the building sustained heavy damage. Negotiations with 
the terrorist were attempted but failed. When the time 
given by the terrorist for demands to be met had 
arrived and the demands were not met, a bomb was 
detonated. The terrorist had demanded the release of 
fellow terrorists confined in Soledad, and safe passage 
from the hostage area. Four terrorists were arrested. 


- The destruction of an explosives experimentation 
building at the Teledyne-McCormick plant in Hollister. 
Six terrorists disguised as workers infiltrated the 
plant and attempted to steal various parts used for 
constructing explosives. It is believed that they had 
planted the bombs prior to the attempted burglary, but 
there is a remote possibility that at least one bomb 
was being carried by a terrorist. It is further 
believed that the terrorists detonated their bombs 
after seeing FBI and CIA agents arrive at the plant, 
possibly thinking they had been discovered (the agents 
were actually arriving to attend a meeting). It is not 
believed that the terrorist attack had any connection 
with the meeting. Aside from losing the building, two 
people were killed, including one terrorist; six others 
were injured. No terrorists were apprehended. 


It is believed that the South Korean terrorist group 
knows the identities of many of the CIA and FBI agents 
working in the United States. This group is considered to 
be extremely dangerous, intelligent and calculating. It is 
assumed that they professionally case target areas for weeks 
prior to striking, leaving little to chance. It has been 
reported through reliable security channels that the group 
now has the capability to build a small nuclear bomb. The 
members of this group will not hesitate to sacrifice their 
own lives in their endeavors. This group has no known long 


term goal, like other terrorist groups. 
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SCENARIO 


A. DGDSS INTRODUCTION 

It is Wednesday, 0915, and you have been told to 
immediately go to a nearby computer network (that links the 
station) in the building you are in. Upon entering the 
network, you are instructed to "standby for a message from 
the Admiral." While you wait, you realize that three other 
students have also entered the network. Finally a message 
comes across the network from the Admiral. He informs all 
four of you that a potential disaster is in the making 
which, if not handled correctly, will result in grave 
consequences. He further informs the four of you that 
Washington (after reviewing your service records) has 
identified your group as the most qualified to handle this 
situation given the circumstances. Realizing that each 
member of your group is located ina different building, and 
that calling all of you in for this meeting may stir up 
attention prematurely, the Admiral directs you and your 


group members to use the network for decision making. 


B. ‘TRADITIONAL INTRODUCTION 
It is Wednesday, 0915, and you have been told to report 
to the Admiral's office ASAP. Upon the arrival of you and 


your fellow group members, the Admiral states that a 


P30 


potential disaster is in the making which if not handled 
correctly will result in some grave consequences. He 
further informs the four of you that Washington (after 
reviewing your service records) has identified your group as 
the most qualified to handle this situation given the 


circumstances. 


C. PROBLEM 

A group of at least five and possibly as many as ten 
South Korean terrorists have infiltrated NPGS. Their 
demands, if any, are unknown at the present time. They have 
not formally contacted any officials. Their presence was 
determined by the discovery of a dummy bomb at 0830 this 
morning, located at the station steam plant. A note 
attached to the bomb reads as follows: 


There are more bombs on this station. The difference 
is that the others are real and may be detonated. Any 
attempt to contact and bring aboard, for assistance in 
this situation, the FBI, CIA, SWAT Team, Police, Special 
Forces from Ft. Ord will automatically result in the 
detonation of the bombs. Any attempt to evacuate the 
station will result in the automatic detonation of the 
bombs. If we do not achieve our purpose and/or we decide 
it is the best way to get your government's attention, we 
will not hesitate to detonate the bombs. This is the only 
bomb you will find easily. You will not have enough time 
to find the others!" 


D. WHAT IS KNOWN 
- Pictures of all South Korean terrorist group members 
that are known will be telefaxed to the station by 
0940. 
- The weather is beautiful with a 20 MPH Southeasterly 


wind. 
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- The terrorists are disguised as South Korean NPGS 
students. 


- Evacuating the station without automobiles will take at 
least an hour; with autos closer to two hours. 


- There are 59 South Korean students at NPGS. 

~- All Security agencies are standing by, ready to assist 
at various locations around Monterey. They are in 
contact with the Admiral by phone. 

- All NPGS military staff personnel are standing by, 
ready to assist. There are 104 officers and 86 
enlisted. 

- NPGS Security department (24 personnel) and Fire 
Department (18 personnel) are standing by ready to 
assist. 

- If a nuclear bomb the size of three books was 
detonated, it could possibly destroy a two-three square 
block area. 

It is assumed that terrorist members are watching the 


station. You know that they want something. 


E. TASK 

GIVEN THIS INFORMATION, THE PAST INFORMATION ON THE 
TERRORISTS AND THE ADJOINING INFORMATION ON POPULATION AREAS 
AND SECURITY AREAS: 


- WHAT IS THE CRITERION (CRITERIA) THAT MUSH GE 
CONSTDERED: 


- WHAT ALTERNATIVES ARE AVAILABLE? 


- WHAT ONE COURSE OF ACTION (A SOLUTION TO THE PROBLEM) 
SHOULD YOUR GROUP TAKE? 


de3.2 


APPENWHEx C 


EXPERT SOLUTION 


A. ASSUMPTIONS 


- The bomb will be detonated. This has already been 
shown through their previous actions. Therefore, we 
must act on the premise that we're working against 
time. We can't sit and do nothing. If we at least do 
something, we stand a chance of finding the bomb and 
defusing it. If we do nothing, we lose. 


- We know we will not be able to meet their demands 
whatever they are. We know there is no negotiating 
with them. 


- We believe they want media attention. 


- There are two common threads with the targets they have 
already hit. One: all three places are heavily 
involved with military contracts. Two: all three 
places have been involved with some aspect of the space 
program. Given this information we would start to look 
for the bomb in Halligan and Spanagel Halls. 


- Our primary objective is to save lives. 


B. ACTIONS 


- Close the base. Do not let anyone enter. Evacuate all 
buildings by sounding fire alarms in each building. 
Immediately evacuate all civilians (except Fire 
Department and Base Police, all students, and all 
Military staff personnel (not involved in assisting 
with the evacuation) via foot from the base. 


- Use Fire Department to assist in rapid building 
evacuation. 


- Use 0-4's and O-5's to direct people to the nearest 
gate. 


- Use Auxiliary Security force to man the gates to let 
people exit and to ensure that no one enters the base. 


3.3 


Have Base Police identify and detain all Koreans. 
Escort Koreans off the base via bus and hold them in 
pre-arranged location on Fort Ord where they will be 
interrogated by the CIA. 


Public Works Officer arranges to have keys taken off 
base and give to EOD team. 


All remaining personnel evacuate the base. 


Call in the SWAT and EOD teams from Fort Ord. Enter 
base after all personnel have evacuated the base. Use 
to search for bomb. Start the search in Halligan and 
Spanagel Halls. 


Contact Monterey Police Department and Sheriff's 
Department to let them know what we are doing. Have 
them evacuate surrounding neighborhoods and cordon off 
those areas to ensure no one enters. 


Station Auxiliary Security force and Base Police two- 
three blocks away from the Base to assist Monterey 
Police in keeping people out of the area and to keep 
base secure. 


Contact California Highway Patrol to stop all traffic 
on Highway One. 
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APPENDIX D 


OBSERVATION FORM 


Start Time Group Date Finish Time 


Pl Time 





Body Posture: 


Facial Expression: 


Communication: 


Number Generated: 


ericeria Alternatives 


EZ Time 


Body Posture: 


Facial Expression: 


Communication: 


Number Generated: 


Criteria Alternatives 


1G hs. 


P3 Time 


Body Posture: 


Facial Expression: 


Communication: 


Number Generated: 


Criteria Alternatives 


P4 Time 


Body Posture: 


Facial Expression: 


Communication: 


Number Generated: 


Criteria Alternatives 


Group Time 
Progress: 
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Body 
Posture 


(P) 


Facial 


Expression 


(A) 


Participating Agitated 


(D) 


Defensive 


(R) 


Relaxed 


(B) 


Bored 


(A) 


Anxious 


Body Posture: 


(S) 


Stoical 


(R) 


Relaxed 


(B) 


Bored 


(RB) 
Rude Behavior 


Communication Group 
Progress 
(PV) (D) 
Positive VerbalDeliberating 
(NV) (B) 
Negative VerbalBrainstorming 
(AL) | (V) 
Active Listening Voting 
ne, (S) 
Inattentive Stagnated 
(W) 
Wiea € ing 
-(R) 
Reading 
(D) 
Discussion 


EXPLANATION OF KEY OBSERVATION POINTS 


Positioning and general carrying of the body as a whole. 


Participating: 


Speaking, 


Defensive: 


Angry, 
migid. 


listening intently, or preparing to speak. 


arms crossed, could be sitting forward or back, 


23:7 


Relaxed: 


Attentive, calm, posture may be slack but not sloppy. 


Bored: 


Sitting back, looking at hands or around the room, sloppy 
posture. 


Anxious: 


Tapping foot or fingers, shaking foot, watching lock 


Facial Expression: 


The expression on the face, the calmness, tenseness, or 
Lack son. 


Agitated: 


Upset, disturbed, frustrated. 


Stolical: 


Indifferent of emotion, impassive, no change in 
expression to display feelings. 


Relaxed: 


Content, .1n- good spirit caine 


Bored: 


Uninterested, apathetic. 


Communication: 


How participant interacts group. 


Positive Verbal: 


Participating in problem discussion, working with the 
Group 
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Negative Verbal: 


Discussion other then the problem, irrelevant remarks. 


Inattentive: 
Not paying attention to the discussion, watching the 
SlOCK. 

Rude Behavior: 


Private discussion, deliberate exclusion of others, etc. 


Netting: 
Recording personal or group thoughts on paper or 
chalkboard. 

Reading: 


Reviewing the problem or aspects of the problem. 


Group Progress: 
Phase of decision process where group is at any given 
time. 

Deliberating: 


Reviewing, stumped, confused. 


Brainstorming: 


Throwing out thoughts on criteria alternatives or facts. 


Vocing: 
Agreeing/disagreeing on a specific set of criteria, 
alternatives, reaching a solution. 

Stagnated Discussion: 
Joking around, not working on problem. 
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